00000100:00100000:1.0F:1788658652.094939:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025293824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658652.095020:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1788658652.095207:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025293824 00000100:00100000:0.0:1788658652.095220:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025293824 00000100:00100000:0.0:1788658652.095267:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788658652.095289:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025293824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658652.095318:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788658652.095378:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025293824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658652.095385:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788658652.095506:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025293824:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788658652.222921:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658653.123933:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025293952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658653.124016:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658653.127013:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025293952 00000100:00100000:1.0:1788658653.127028:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025293952 00000100:00100000:1.0:1788658653.127096:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658653.127109:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025293952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658653.127151:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788658653.127232:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025293952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658653.127239:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788658653.127261:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658653.127304:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025293952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788658653.247889:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788658653.635387:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000020:00080000:0.0:1788658653.635407:0:17142:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1e90205840 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1788658653.635412:0:17142:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1eadb68900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1e90205b40 00000020:00080000:0.0:1788658653.635416:0:17142:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1eadb68d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1d8255bc00 00000020:00080000:0.0:1788658653.635443:0:17201:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1788658653.635525:0:17201:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788658653.638291:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658653.638306:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658653.638385:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658653.638391:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658653.638396:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658653.638412:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658653.638429:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:0.0:1788658653.638432:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658653.638437:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658653.638442:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658653.644048:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658653.644072:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025294080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0F:1788658653.644126:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025294208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658653.644144:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658653.644172:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658653.644202:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025294080 00000100:00100000:0.0:1788658653.644211:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025294080 00000100:00100000:3.0:1788658653.644222:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025294208 00000100:00100000:3.0:1788658653.644227:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025294208 00000100:00100000:0.0:1788658653.644258:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788658653.644268:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025294080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658653.644301:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788658653.644370:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025294080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658653.644377:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788658653.644393:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788658653.644399:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025294208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658653.644413:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788658653.644438:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025294208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 40us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658653.644454:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788658653.646914:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025294080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658653.656009:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025294208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658654.084839:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658654.084936:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001097088 00000100:00100000:1.0:1788658654.084945:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001097088 00000100:00100000:1.0:1788658654.085022:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:1.0:1788658654.085032:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+13:15574:x1875544001097088:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788658654.085130:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+13:15574:x1875544001097088:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 Request processed in 99us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658654.085137:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00080000:3.0:1788658654.085610:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658654.088828:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658654.088917:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001097216 00000100:00100000:1.0:1788658654.088926:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001097216 00000100:00100000:1.0:1788658654.088997:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:1.0:1788658654.089009:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+5:15574:x1875544001097216:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788658654.089104:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+5:15574:x1875544001097216:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 Request processed in 98us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658654.089121:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00080000:3.0:1788658654.089480:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788658654.096082:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658654.096167:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001097472 00000100:00100000:3.0:1788658654.096179:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001097472 00000100:00100000:3.0:1788658654.096244:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:3.0:1788658654.096255:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f934723f-b66d-409a-bfc9-9b206b383163+13:15574:x1875544001097472:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788658654.096509:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f934723f-b66d-409a-bfc9-9b206b383163+14:15574:x1875544001097472:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 256us (437us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788658654.096527:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00010000:00010000:1.0:1788658654.270966:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658655.297351:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658655.490002:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0F:1788658656.194393:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025294336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658656.194485:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658656.194571:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025294336 00000100:00100000:2.0:1788658656.194578:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025294336 00000100:00100000:2.0:1788658656.194755:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658656.194766:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025294336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658656.194796:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788658656.194840:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025294336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658656.194846:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788658656.194866:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658656.194902:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025294336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658656.195079:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025294464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658656.195115:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658656.195970:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025294976:0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.196009:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658656.196029:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025295488:0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.196050:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658656.196071:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788658656.196077:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025294592:0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.196101:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658656.196123:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025295104:0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.196147:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658656.196165:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025295616:0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.196185:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658656.196211:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025294976 00000100:00100000:0.0:1788658656.196217:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025294976 00000100:00100000:0.0:1788658656.196253:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025295488 00000100:00100000:0.0:1788658656.196256:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025295488 00000100:00100000:0.0:1788658656.196278:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025295616 00000100:00100000:0.0:1788658656.196281:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025295616 00000100:00100000:0.0:1788658656.196296:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788658656.196303:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025294976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.196344:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025294976:12345-0@lo:400:kworker.0 Request processed in 42us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658656.196358:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788658656.196374:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788658656.196380:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025295488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.196409:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025295488:12345-0@lo:400:kworker.0 Request processed in 30us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658656.196415:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788658656.196426:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788658656.196431:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025295616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.196456:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025295616:12345-0@lo:400:kworker.0 Request processed in 25us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658656.196461:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788658656.196479:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025295104 00000100:00100000:0.0:1788658656.196483:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025295104 00000100:00100000:0.0:1788658656.196508:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788658656.196515:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025295104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.196544:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025295104:12345-0@lo:400:kworker.0 Request processed in 30us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658656.196550:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788658656.197751:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025295104:0@lo:400:kworker.0 00010000:00080000:0.0:1788658656.197783:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb1c94700 x1875544025295616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658656.197794:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025295616:0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.197807:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025294976:0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.197816:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025295488:0@lo:400:kworker.0 00000100:00100000:2.0:1788658656.197938:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025294592 00000100:00100000:2.0:1788658656.197944:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025294592 00000100:00100000:2.0:1788658656.197986:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788658656.197994:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3647:x1875544025294592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658656.198055:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3647:x1875544025294592:12345-0@lo:400:kworker.0 Request processed in 61us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658656.198062:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788658656.198098:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025294720:0@lo:400:kworker.0 00000100:00100000:2.0:1788658656.198129:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658656.198149:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025295232:0@lo:400:kworker.0 00000100:00100000:2.0:1788658656.198170:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658656.198187:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025295744:0@lo:400:kworker.0 00000100:00100000:2.0:1788658656.198208:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658656.198226:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788658656.198242:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025294848:0@lo:400:kworker.0 00000100:00100000:2.0:1788658656.198263:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658656.198278:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025295360:0@lo:400:kworker.0 00000100:00100000:2.0:1788658656.198298:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658656.198311:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025295872:0@lo:400:kworker.0 00000100:00100000:2.0:1788658656.198329:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788658656.198350:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658656.198355:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658656.198366:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025294464 00000100:00100000:2.0:1788658656.198369:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025294464 00000100:00100000:2.0:1788658656.198402:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788658656.198410:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025294464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658656.198424:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788658656.198456:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025294464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658656.198461:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788658656.198476:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658656.198856:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025294592:0@lo:400:kworker.0 00000100:00100000:3.0:1788658656.198878:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025294464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658656.198902:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025294720 00000100:00100000:3.0:1788658656.198906:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025294720 00000100:00100000:3.0:1788658656.198933:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788658656.198939:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025294720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658656.198983:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025294720:12345-0@lo:400:kworker.0 Request processed in 44us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658656.198989:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788658656.199008:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025295232 00000100:00100000:3.0:1788658656.199018:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025295232 00000100:00100000:3.0:1788658656.199048:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025294848 00000100:00100000:3.0:1788658656.199051:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025294848 00000100:00100000:3.0:1788658656.199069:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788658656.199074:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025295232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658656.199118:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025295232:12345-0@lo:400:kworker.0 Request processed in 43us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658656.199124:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788658656.199135:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788658656.199140:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025294848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658656.199166:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025294848:12345-0@lo:400:kworker.0 Request processed in 26us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658656.199170:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788658656.199191:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658656.199207:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025294848:0@lo:400:kworker.0 00000100:00100000:3.0:1788658656.199217:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025294720:0@lo:400:kworker.0 00000100:00100000:3.0:1788658656.199226:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025295232:0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.199436:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025295744 00000100:00100000:0.0:1788658656.199441:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025295744 00000100:00100000:0.0:1788658656.199482:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025295360 00000100:00100000:0.0:1788658656.199485:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025295360 00000100:00100000:0.0:1788658656.199501:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025295872 00000100:00100000:0.0:1788658656.199503:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025295872 00000100:00100000:0.0:1788658656.199518:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788658656.199524:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025295744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.199562:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025295744:12345-0@lo:400:kworker.0 Request processed in 38us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658656.199568:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788658656.199583:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788658656.200795:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788658656.200813:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025295872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658656.200874:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025295872:12345-0@lo:400:kworker.0 Request processed in 69us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658656.200881:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788658656.200927:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb90380 x1875544025295872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658656.200941:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025295872:0@lo:400:kworker.0 00000100:00100000:2.0:1788658656.200955:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025295744:0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.201101:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025295360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658656.201152:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025295360:12345-0@lo:400:kworker.0 Request processed in 1564us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658656.201159:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788658656.201318:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025295360:0@lo:400:kworker.0 00000100:00080000:3.0:1788658656.201378:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658656.201382:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788658656.323345:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658656.451216:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658656.451262:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658656.451293:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658656.451333:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658656.451400:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001097600 00000100:00100000:0.0:1788658656.451411:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001097600 00000100:00100000:3.0:1788658656.451450:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001097856 00000100:00100000:3.0:1788658656.451456:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001097856 00000100:00100000:0.0:1788658656.451481:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 172 00000100:00100000:0.0:1788658656.451495:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2397:x1875544001097600:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658656.451506:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001097728 00000100:00100000:3.0:1788658656.451511:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001097728 00000100:00100000:3.0:1788658656.451537:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:3.0:1788658656.451546:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001097856:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658656.451572:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2397:x1875544001097600:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 79us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658656.451580:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 172 00000100:00100000:3.0:1788658656.451587:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001097856:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 41us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658656.451611:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:0.0:1788658656.451638:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:0.0:1788658656.451647:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+14:2397:x1875544001097728:12345-192.168.202.53@tcp:400:kworker.0 00000100:00080000:3.0:1788658656.451655:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658656.451660:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658656.451672:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001097984 00000100:00100000:3.0:1788658656.451676:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001097984 00000100:00100000:0.0:1788658656.451694:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+14:2397:x1875544001097728:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 47us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658656.451781:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:0.0:1788658656.451823:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:0.0:1788658656.451832:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001097984:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658656.451861:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001097984:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 31us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658656.451869:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00080000:3.0:1788658656.452387:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658656.461478:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658656.461522:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658656.461567:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658656.461612:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658656.462002:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001098112 00000100:00100000:1.0:1788658656.462013:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001098112 00000100:00100000:1.0:1788658656.462084:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001098496 00000100:00100000:1.0:1788658656.462088:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001098496 00000100:00100000:1.0:1788658656.462112:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:1.0:1788658656.462121:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f934723f-b66d-409a-bfc9-9b206b383163+5:2395:x1875544001098112:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:1.0:1788658656.462149:0:18667:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fef7 00000100:00080000:1.0:1788658656.462164:0:18667:0:(import.c:65:import_set_state_nolock()) ffff8a1d821b5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788658656.462208:0:18667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788658656.462370:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f934723f-b66d-409a-bfc9-9b206b383163+2:2395:x1875544001098112:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 249us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658656.462377:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:1.0:1788658656.462393:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:1.0:1788658656.462400:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2395:x1875544001098496:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:1.0:1788658656.462410:0:18667:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6ff2f 00000100:00080000:1.0:1788658656.462417:0:18667:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1215800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788658656.462437:0:18667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788658656.462515:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+2:2395:x1875544001098496:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 115us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658656.462522:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00010000:00010000:1.0:1788658656.462540:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658656.462546:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658656.463016:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001098240 00000100:00100000:2.0:1788658656.463023:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001098240 00000100:00100000:2.0:1788658656.463066:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001098368 00000100:00100000:2.0:1788658656.463070:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001098368 00000100:00100000:2.0:1788658656.463095:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:2.0:1788658656.463102:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2397:x1875544001098240:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658656.463142:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2397:x1875544001098240:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 41us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658656.463148:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:2.0:1788658656.463162:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:2.0:1788658656.463168:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2397:x1875544001098368:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658656.463189:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2397:x1875544001098368:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 21us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658656.463195:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00080000:0.0:1788658656.463290:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658656.463294:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658656.463297:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788658656.463299:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658656.466324:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658656.466411:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001098624 00000100:00100000:1.0:1788658656.466420:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001098624 00000100:00100000:1.0:1788658656.466497:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:1.0:1788658656.466507:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2395:x1875544001098624:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:1.0:1788658656.466546:0:18667:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6ff36 00000100:00080000:1.0:1788658656.466555:0:18667:0:(import.c:65:import_set_state_nolock()) ffff8a1eb5e62800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788658656.466614:0:18667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788658656.466838:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+2:2395:x1875544001098624:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 332us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658656.466846:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00010000:00010000:3.0:1788658656.467535:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658656.470045:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658657.220806:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658657.220860:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025296000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658657.220985:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658657.221608:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025296000 00000100:00100000:1.0:1788658657.221621:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025296000 00000100:00100000:1.0:1788658657.221729:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788658657.221743:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025296000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658657.221787:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788658657.221881:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025296000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658657.221890:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788658657.222022:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025296000:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788658657.343211:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658657.763808:0:20537:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 21:37:35 (1788658655) 00000100:00100000:0.0:1788658658.239651:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658658.239686:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025296128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658658.239964:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658658.240072:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025296128 00000100:00100000:1.0:1788658658.240083:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025296128 00000100:00100000:1.0:1788658658.240162:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658658.240176:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025296128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658658.240225:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788658658.240291:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025296128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658658.240299:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788658658.240513:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658658.240563:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025296128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788658658.367100:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658658.750918:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658658.750959:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025296256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658658.751058:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658658.751156:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025296256 00000100:00100000:3.0:1788658658.751167:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025296256 00000100:00100000:3.0:1788658658.751236:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788658658.751248:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025296256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658658.751295:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788658658.751440:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025296256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 193us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658658.751449:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788658658.751608:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025296256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658658.752998:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658658.753019:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025296384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658658.753084:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658658.754017:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025296384 00000100:00100000:3.0:1788658658.754030:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025296384 00000100:00100000:3.0:1788658658.754092:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788658658.754102:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025296384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658658.754146:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788658658.754234:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025296384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658658.754243:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788658658.754358:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025296384:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788658659.391568:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788658659.782502:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1788658659.782521:0:17142:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1788658659.782546:0:17201:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1788658659.782562:0:17201:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:1.0:1788658660.287498:0:17196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788658660.287510:0:17196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658660.287535:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788658660.287543:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788658660.415927:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658661.311446:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025296512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658661.311568:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658661.311853:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025296768:0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.311889:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658661.311917:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025297280:0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.311944:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658661.311962:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025297792:0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.311989:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658661.312226:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025296512 00000100:00100000:0.0:1788658661.312235:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025296512 00000100:00100000:0.0:1788658661.312314:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658661.312327:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025296512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658661.312370:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788658661.312434:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025296512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658661.312443:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788658661.312478:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658661.312518:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025296896:0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.312557:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658661.312586:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025297408:0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.312616:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658661.312643:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025297920:0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.312693:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025297024:0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.312768:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025297280 00000100:00100000:0.0:1788658661.312773:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025297280 00000100:00100000:0.0:1788658661.312809:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025296896 00000100:00100000:0.0:1788658661.312813:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025296896 00000100:00100000:0.0:1788658661.312828:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025297408 00000100:00100000:0.0:1788658661.312830:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025297408 00000100:00100000:0.0:1788658661.312843:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658661.312848:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025297280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.312883:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025297280:12345-0@lo:400:kworker.0 Request processed in 34us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658661.312889:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658661.312901:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658661.312905:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025296896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.312944:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025296896:12345-0@lo:400:kworker.0 Request processed in 39us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658661.312950:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658661.312963:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658661.312969:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025297408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.312993:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025297408:12345-0@lo:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658661.313028:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025296640:0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.313058:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788658661.313076:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658661.313079:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658661.313105:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025296768 00000100:00100000:0.0:1788658661.313109:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025296768 00000100:00100000:0.0:1788658661.313137:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788658661.313142:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658661.313149:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025296768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658661.313196:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025297152:0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.313208:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025296768:12345-0@lo:400:kworker.0 Request processed in 61us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658661.313216:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788658661.313230:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658661.313253:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025297152 00000100:00100000:3.0:1788658661.313258:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025297664:0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.313259:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025297152 00000100:00100000:0.0:1788658661.313291:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788658661.313299:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025296640 00000100:00100000:0.0:1788658661.313301:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025297152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658661.313304:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025296640 00000100:00100000:3.0:1788658661.313348:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788658661.313353:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025297152:12345-0@lo:400:kworker.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658661.313360:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3648:x1875544025296640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.313365:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788658661.313405:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3648:x1875544025296640:12345-0@lo:400:kworker.0 Request processed in 49us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658661.313413:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788658661.313745:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025297792 00000100:00100000:2.0:1788658661.313751:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025296768:0@lo:400:kworker.0 00000100:00100000:1.0:1788658661.313752:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025297792 00000100:00100000:2.0:1788658661.313772:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025297280:0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.313806:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658661.313828:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025297536:0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.313854:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658661.313872:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025298048:0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.313892:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658661.313925:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025296512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658661.313949:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025297024 00000100:00100000:2.0:1788658661.313952:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025297024 00000100:00100000:0.0:1788658661.314023:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658661.314059:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025296896:0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.314085:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025297408:0@lo:400:kworker.0 00000100:00080000:0.0:1788658661.314112:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658661.314127:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025297536 00000100:00100000:0.0:1788658661.314130:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025297536 00000100:00100000:1.0:1788658661.316326:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025298048 00000100:00100000:1.0:1788658661.316346:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025298048 00000100:00100000:3.0:1788658661.316499:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658661.316558:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025298176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658661.316629:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658661.316682:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025296640:0@lo:400:kworker.0 00000100:00100000:3.0:1788658661.316699:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025297152:0@lo:400:kworker.0 00000100:00100000:3.0:1788658661.316762:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025297920 00000100:00100000:3.0:1788658661.316766:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025297920 00000100:00100000:2.0:1788658661.316853:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025297664 00000100:00100000:2.0:1788658661.316858:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025297664 00000100:00100000:2.0:1788658661.316881:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788658661.316892:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025297792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.316958:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025297792:12345-0@lo:400:kworker.0 Request processed in 69us (4969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658661.316966:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788658661.320933:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788658661.320970:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025297024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.321116:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025297024:12345-0@lo:400:kworker.0 Request processed in 165us (7308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658661.321125:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788658661.321153:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788658661.321161:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025297664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.322362:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025297664:12345-0@lo:400:kworker.0 Request processed in 1194us (5859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658661.322375:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788658661.322462:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025297024:0@lo:400:kworker.0 00010000:00080000:2.0:1788658661.322511:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83799f80 x1875544025297792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658661.322523:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025297792:0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.322572:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025298176 00000100:00100000:2.0:1788658661.322580:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025298176 00000100:00100000:2.0:1788658661.322631:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788658661.322638:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025298176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658661.322664:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788658661.322701:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025298176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (6071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658661.322731:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788658661.322771:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025297664:0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.322792:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025298176:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788658661.322860:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658661.322866:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658661.323028:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788658661.323040:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025297536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658661.323092:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025297536:12345-0@lo:400:kworker.0 Request processed in 57us (9237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658661.323099:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788658661.323129:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025297536:0@lo:400:kworker.0 00000100:00100000:1.0:1788658661.328738:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788658661.328770:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025298048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658661.328979:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025298048:12345-0@lo:400:kworker.0 Request processed in 226us (15084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658661.328988:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788658661.329399:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788658661.329414:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025297920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658661.329497:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025297920:12345-0@lo:400:kworker.0 Request processed in 88us (15472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658661.329504:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788658661.329545:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834e4380 x1875544025298048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658661.329566:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025298048:0@lo:400:kworker.0 00000100:00100000:2.0:1788658661.329661:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025297920:0@lo:400:kworker.0 00010000:00010000:1.0:1788658661.439470:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658661.563122:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658661.563169:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658661.563219:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658661.563250:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658661.563295:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658661.563319:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001099008 00000100:00100000:3.0:1788658661.563332:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658661.563334:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001099008 00000100:00080000:2.0:1788658661.563373:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658661.563610:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001098752 00000100:00100000:0.0:1788658661.563616:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001098752 00000100:00100000:0.0:1788658661.563661:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 174 00000100:00100000:0.0:1788658661.563674:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2397:x1875544001098752:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658661.563812:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2397:x1875544001098752:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 140us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658661.563821:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 174 00000100:00100000:0.0:1788658661.564579:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001099136 00000100:00100000:0.0:1788658661.564588:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001099136 00000100:00100000:0.0:1788658661.564645:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:0.0:1788658661.564655:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001099136:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658661.564750:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001099136:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 96us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658661.564758:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00080000:2.0:1788658661.566599:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658661.566624:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001099264 00000100:00100000:2.0:1788658661.566639:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001099264 00000100:00080000:2.0:1788658661.566673:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658661.566720:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001098880 00000100:00100000:2.0:1788658661.566724:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001098880 00000100:00080000:2.0:1788658661.566739:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658661.566751:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001099392 00000100:00100000:2.0:1788658661.566754:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001099392 00000100:00080000:2.0:1788658661.566766:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658661.566789:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 88 00000100:00100000:2.0:1788658661.566800:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001099008:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658661.566890:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001099008:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 93us (3720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658661.566898:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 88 00000100:00100000:2.0:1788658661.566920:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:2.0:1788658661.566926:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2397:x1875544001099264:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658661.566955:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2397:x1875544001099264:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 29us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658661.566961:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:2.0:1788658661.566973:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:2.0:1788658661.566979:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+13:2397:x1875544001098880:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658661.567020:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+13:2397:x1875544001098880:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 42us (3769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658661.567027:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:2.0:1788658661.567040:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 91 00000100:00100000:2.0:1788658661.567046:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2397:x1875544001099392:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658661.567157:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2397:x1875544001099392:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 111us (3825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658661.567164:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 91 00000001:00100000:1.0:1788658661.829439:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000020:00000080:1.0:1788658661.829453:0:18664:0:(genops.c:885:class_export_put()) final put ffff8a1ec1213800/dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000020:00000080:2.0:1788658661.829961:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1213800/dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad for lustre-OST0000 00000020:00000080:2.0:1788658661.830032:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ec1215800 for lustre-OST0000 00000001:00100000:3.0:1788658661.830476:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000020:00000080:3.0:1788658661.830484:0:19484:0:(genops.c:885:class_export_put()) final put ffff8a1eb5e62000/dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000001:00100000:3.0:1788658661.835949:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f934723f-b66d-409a-bfc9-9b206b383163 00000020:00000080:3.0:1788658661.835963:0:19484:0:(genops.c:885:class_export_put()) final put ffff8a1d821b7800/f934723f-b66d-409a-bfc9-9b206b383163 00000020:00000080:0.0:1788658661.836074:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb5e62000/dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad for lustre-OST0001 00000020:00000080:0.0:1788658661.836167:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb5e62800 for lustre-OST0001 00000020:00000080:2.0:1788658661.841880:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d821b7800/f934723f-b66d-409a-bfc9-9b206b383163 for lustre-OST0001 00000020:00000080:2.0:1788658661.841957:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d821b5000 for lustre-OST0001 00000100:00100000:2.0:1788658662.335237:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025298304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658662.335364:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658662.335931:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025298304 00000100:00100000:3.0:1788658662.335946:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025298304 00000100:00100000:3.0:1788658662.336022:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658662.336033:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025298304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788658662.336075:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788658662.336154:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025298304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658662.336162:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788658662.336289:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025298304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658662.461419:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658662.461571:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001099648 00000100:00100000:1.0:1788658662.461607:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001099648 00000100:00100000:1.0:1788658662.461699:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:1.0:1788658662.461754:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+13:16335:x1875544001099648:12345-192.168.202.53@tcp:35:umount.0 00000001:00080000:1.0:1788658662.462181:0:17165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934623 00000001:00080000:1.0:1788658662.462308:0:17165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:1.0:1788658662.462479:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+16:16335:x1875544001099648:12345-192.168.202.53@tcp:35:umount.0 Request processed in 728us (1083us total) trans 8589934625 rc 0/0 00000100:00100000:1.0:1788658662.462490:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000020:00080000:1.0:1788658662.462497:0:17165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788658662.470162:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658662.470357:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658662.470404:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658662.470447:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658662.470556:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001099776 00000100:00100000:1.0:1788658662.470570:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001099776 00000100:00100000:1.0:1788658662.470651:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001100032 00000100:00100000:1.0:1788658662.470655:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001100032 00000100:00100000:1.0:1788658662.470668:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001099904 00000100:00100000:1.0:1788658662.470671:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001099904 00000100:00100000:1.0:1788658662.470689:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:1.0:1788658662.470728:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+15:2399:x1875544001099776:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658662.470749:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658662.470776:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ebf602000/0x48e67cc629c6fecd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaf9 expref: 15 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658662.470811:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658662.470877:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+14:2399:x1875544001099776:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 177us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658662.470886:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:1.0:1788658662.470906:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:1.0:1788658662.470913:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eabc43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2399:x1875544001100032:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658662.470922:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658662.470949:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6ff91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbe0 expref: 13 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658662.470959:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658662.470978:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eabc43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:2399:x1875544001100032:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 65us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658662.470985:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:1.0:1788658662.471037:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:1.0:1788658662.471043:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:2399:x1875544001099904:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658662.471051:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658662.471061:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c6fed4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb2a expref: 11 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658662.471070:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658662.471087:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:2399:x1875544001099904:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 44us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658662.471094:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:1.0:1788658662.478549:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658662.478753:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001100160 00000100:00100000:0.0:1788658662.478770:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001100160 00000100:00100000:0.0:1788658662.478868:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:0.0:1788658662.478882:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f934723f-b66d-409a-bfc9-9b206b383163+5:2395:x1875544001100160:12345-192.168.202.53@tcp:9:umount.0 00000020:00000080:0.0:1788658662.478941:0:18670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fef0 00000100:00080000:0.0:1788658662.478956:0:18670:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1212000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658662.479021:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788658662.479270:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f934723f-b66d-409a-bfc9-9b206b383163+2:2395:x1875544001100160:12345-192.168.202.53@tcp:9:umount.0 Request processed in 390us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658662.479288:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00010000:00010000:1.0:1788658662.481163:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658662.488273:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658662.488384:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001101056 00000100:00100000:1.0:1788658662.488401:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001101056 00000100:00100000:1.0:1788658662.488482:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:1.0:1788658662.488494:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+16:2395:x1875544001101056:12345-192.168.202.53@tcp:39:umount.0 00000020:00000080:1.0:1788658662.488556:0:20300:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fee2 00000020:00010000:1.0:1788658662.488584:0:20300:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a1e840a7000: total 0 00000100:00080000:1.0:1788658662.488590:0:20300:0:(import.c:65:import_set_state_nolock()) ffff8a1e840a2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788658662.488663:0:20300:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000020:00010000:3.0:1788658662.489114:0:17151:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a1e840a7000: total 0 00010000:00010000:3.0:1788658662.489121:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658662.489201:0:17151:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a1e840a7000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788658662.489251:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:3.0:1788658662.489256:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658662.489268:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70120 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc5e expref: 16 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658662.489325:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83406a00) 00010000:00010000:3.0:1788658662.489329:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658662.489333:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391200/0x48e67cc629c6ffc9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbee expref: 15 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658662.489360:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83406900) 00010000:00010000:3.0:1788658662.489363:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658662.489367:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c70008 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbfc expref: 14 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658662.489381:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:3.0:1788658662.489384:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788658662.489388:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc49 expref: 13 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658662.489402:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:3.0:1788658662.489404:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658662.489408:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c6ffad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbe7 expref: 12 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658662.489426:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:3.0:1788658662.489429:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658662.489432:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2800/0x48e67cc629c7017b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc73 expref: 11 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658662.489449:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:3.0:1788658662.489457:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658662.489462:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc96 expref: 10 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658662.489481:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:3.0:1788658662.489484:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788658662.489487:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c70071 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc1f expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658662.489500:0:17151:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a1e840a7000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1788658662.489514:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658662.489516:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658662.489518:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658662.492220:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+6:2395:x1875544001101056:12345-192.168.202.53@tcp:39:umount.0 Request processed in 3712us (3950us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1788658662.492256:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:3.0:1788658662.514864:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658662.515960:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001101184 00000100:00100000:2.0:1788658662.515983:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001101184 00000100:00100000:2.0:1788658662.516078:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:2.0:1788658662.516092:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+5:2395:x1875544001101184:12345-192.168.202.53@tcp:39:umount.0 00000020:00000080:2.0:1788658662.516144:0:17164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fee9 00000100:00080000:2.0:1788658662.516168:0:17164:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658662.516336:0:17164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788658662.518927:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658662.521377:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+3:2395:x1875544001101184:12345-192.168.202.53@tcp:39:umount.0 Request processed in 5263us (6507us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788658662.521397:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:0.0:1788658663.359230:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025298432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658663.359353:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658663.359570:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025298432 00000100:00100000:3.0:1788658663.359582:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025298432 00000100:00100000:3.0:1788658663.359684:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788658663.359698:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025298432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658663.359760:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00080000:2.0:1788658663.359848:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658663.362725:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025298432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2996us (3338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658663.362747:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788658663.363147:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025298432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788658663.488171:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658663.871095:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025298560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658663.871204:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658663.871561:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025298688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658663.871604:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658663.871739:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025298560 00000100:00100000:1.0:1788658663.871750:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025298560 00000100:00100000:1.0:1788658663.871814:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025298688 00000100:00100000:1.0:1788658663.871818:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025298688 00000100:00100000:1.0:1788658663.871839:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788658663.871851:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025298560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788658663.871898:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788658663.872013:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788658663.872024:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025298688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658663.872048:0:18107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788658663.872173:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025298560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 323us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658663.872181:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788658663.872288:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025298560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658663.876089:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025298688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4052us (4468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658663.876126:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788658663.876440:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025298688:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788658664.511866:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658664.539451:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658664.539883:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001101312 00000100:00100000:1.0:1788658664.539898:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001101312 00000100:00100000:1.0:1788658664.539994:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:1.0:1788658664.540007:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:2397:x1875544001101312:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658664.540030:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658664.540054:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83419400/0x48e67cc629c6ff0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb69 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658664.540077:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658664.540149:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+9:2397:x1875544001101312:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 144us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658664.540157:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1788658664.540596:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658664.540787:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658664.541616:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001101568 00000100:00100000:0.0:1788658664.541629:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001101568 00000100:00100000:0.0:1788658664.543256:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001101440 00000100:00100000:0.0:1788658664.543271:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001101440 00000100:00100000:0.0:1788658664.543327:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1788658664.543342:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:2397:x1875544001101568:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658664.543363:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658664.543389:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ff6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd9 expref: 10 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658664.543412:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658664.543508:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+9:2397:x1875544001101568:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 168us (3979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658664.543516:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1788658664.544245:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:0.0:1788658664.544258:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+8:2397:x1875544001101440:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658664.544271:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658664.544284:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6ff13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb9a expref: 8 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658664.544299:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658664.544397:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+7:2397:x1875544001101440:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 142us (3609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658664.544405:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1788658664.546595:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658664.546814:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001101824 00000100:00100000:0.0:1788658664.546847:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001101824 00000100:00100000:0.0:1788658664.546949:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:0.0:1788658664.546963:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2395:x1875544001101824:12345-192.168.202.53@tcp:39:umount.0 00000020:00000080:0.0:1788658664.547021:0:17162:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6ff21 00000020:00010000:0.0:1788658664.547033:0:17162:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a1ebf635800: total 0 00000100:00080000:0.0:1788658664.547039:0:17162:0:(import.c:65:import_set_state_nolock()) ffff8a1ebf633800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1788658664.547109:0:17151:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a1ebf635800: total 0 00010000:00010000:0.0:1788658664.547254:0:17151:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a1ebf635800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788658664.547302:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83406900) 00010000:00010000:0.0:1788658664.547306:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00080000:3.0:1788658664.547606:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:3.0:1788658664.547630:0:17162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:3.0:1788658664.547939:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2395:x1875544001101824:12345-192.168.202.53@tcp:39:umount.0 Request processed in 977us (1633us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1788658664.547964:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 68 00010000:00010000:0.0:1788658664.548202:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602e00/0x48e67cc629c70016 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc03 expref: 4 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658664.548247:0:17151:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a1ebf635800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788658664.548278:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658664.548281:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658664.548283:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658664.557678:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658664.558124:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001101952 00000100:00100000:1.0:1788658664.558137:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001101952 00000100:00100000:1.0:1788658664.558235:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:1.0:1788658664.558250:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2395:x1875544001101952:12345-192.168.202.53@tcp:39:umount.0 00000100:00080000:3.0:1788658664.558303:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:1.0:1788658664.558332:0:20300:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6ff28 00000100:00080000:1.0:1788658664.558346:0:20300:0:(import.c:65:import_set_state_nolock()) ffff8a1d810f2000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788658664.558594:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788658664.558633:0:20300:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788658664.558912:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+3:2395:x1875544001101952:12345-192.168.202.53@tcp:39:umount.0 Request processed in 664us (1248us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788658664.558921:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:2.0:1788658664.592685:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658664.593356:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001102208 00000100:00100000:3.0:1788658664.593428:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001102208 00000100:00100000:3.0:1788658664.593576:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 175 00000100:00100000:3.0:1788658664.593590:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+7:2395:x1875544001102208:12345-192.168.202.53@tcp:251:umount.0 00000020:00000080:3.0:1788658664.593659:0:17154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6febf 00000020:00010000:3.0:1788658664.593669:0:17154:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a1e840a3000: total 0 00000100:00080000:3.0:1788658664.593676:0:17154:0:(import.c:65:import_set_state_nolock()) ffff8a1e840a4000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788658664.593821:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+3:2395:x1875544001102208:12345-192.168.202.53@tcp:251:umount.0 Request processed in 234us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658664.593830:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 175 00000020:00010000:1.0:1788658664.594431:0:17151:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a1e840a3000: total 0 00010000:00010000:1.0:1788658664.594438:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658664.594521:0:17151:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a1e840a3000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788658664.594571:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83419e00/0x48e67cc629c6fec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaf2 expref: 2 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658664.594591:0:17151:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a1e840a3000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788658664.594603:0:17151:0:(genops.c:885:class_export_put()) final put ffff8a1e840a3000/67137b4e-5d5d-4374-acb2-2bfe6af790cf 00010000:00010000:1.0:1788658664.594626:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658664.594628:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658664.594631:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788658664.595023:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e840a3000/67137b4e-5d5d-4374-acb2-2bfe6af790cf for MGS 00000020:00000080:2.0:1788658664.595073:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1e840a4000 for MGS 00010000:00010000:1.0:1788658665.537914:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658665.729770:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788658666.441511:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025298816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658666.441587:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658666.441603:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025298944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658666.441632:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658666.441683:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025298816 00000100:00100000:0.0:1788658666.441683:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025298944 00000100:00100000:1.0:1788658666.441692:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025298816 00000100:00100000:0.0:1788658666.441692:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025298944 00000100:00100000:0.0:1788658666.441864:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788658666.441873:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025298944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658666.441906:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788658666.441954:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025298944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658666.441960:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788658666.442021:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025298944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658666.442561:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025299456:0@lo:400:kworker.0 00000100:00100000:3.0:1788658666.442599:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658666.442626:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025299968:0@lo:400:kworker.0 00000100:00100000:3.0:1788658666.442788:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658666.442811:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788658666.442818:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025299328:0@lo:400:kworker.0 00000100:00100000:3.0:1788658666.442858:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658666.442887:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025299840:0@lo:400:kworker.0 00000100:00100000:3.0:1788658666.442909:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658666.442928:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025300352:0@lo:400:kworker.0 00000100:00100000:3.0:1788658666.442949:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658666.442976:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025299328 00000100:00100000:3.0:1788658666.442996:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025299328 00000100:00100000:1.0:1788658666.450339:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788658666.450357:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025298816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658666.450396:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788658666.450509:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025298816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (8921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658666.450537:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788658666.450649:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025298816:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788658666.450960:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658666.450988:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025299456 00000100:00100000:1.0:1788658666.450998:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025299456 00000100:00100000:1.0:1788658666.451034:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025299968 00000100:00100000:1.0:1788658666.451038:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025299968 00000100:00100000:1.0:1788658666.451062:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025299840 00000100:00100000:1.0:1788658666.451066:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025299840 00000100:00100000:1.0:1788658666.451081:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025300352 00000100:00100000:1.0:1788658666.451085:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025300352 00000100:00100000:1.0:1788658666.451102:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788658666.451110:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025299456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.451166:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025299456:12345-0@lo:400:kworker.0 Request processed in 58us (8567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658666.451173:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788658666.451185:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788658666.451191:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025299968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.451218:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025299968:12345-0@lo:400:kworker.0 Request processed in 28us (8430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658666.451224:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788658666.451236:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788658666.451242:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025299840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.451268:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025299840:12345-0@lo:400:kworker.0 Request processed in 27us (8359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658666.451273:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788658666.451283:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788658666.451298:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025300352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.451328:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025300352:12345-0@lo:400:kworker.0 Request processed in 31us (8378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658666.451333:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788658666.451364:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025299200:0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.451408:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658666.451939:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025299712:0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.451974:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658666.451999:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025300224:0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.452023:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658666.452047:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788658666.452054:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025299072:0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.452085:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658666.452108:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025299584:0@lo:400:kworker.0 00000100:00080000:2.0:1788658666.452117:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658666.452122:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658666.452125:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658666.452132:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658666.452149:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025300096:0@lo:400:kworker.0 00000100:00100000:2.0:1788658666.452156:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025300224 00000100:00100000:2.0:1788658666.452162:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025300224 00000100:00100000:1.0:1788658666.452169:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658666.452197:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025300096 00000100:00100000:2.0:1788658666.452200:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025300096 00000100:00100000:1.0:1788658666.452221:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788658666.452230:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025300224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.452275:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025300224:12345-0@lo:400:kworker.0 Request processed in 47us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658666.452281:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788658666.452290:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788658666.452297:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025300096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.452327:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025299840:0@lo:400:kworker.0 00000100:00100000:2.0:1788658666.452333:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025300096:12345-0@lo:400:kworker.0 Request processed in 38us (163us total) trans 0 rc 0/0 00010000:00080000:1.0:1788658666.452343:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d57480 x1875544025300352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658666.452360:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025300352:0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.452377:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025299456:0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.452389:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025299968:0@lo:400:kworker.0 00000100:00100000:3.0:1788658666.452978:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025299712 00000100:00100000:3.0:1788658666.452985:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025299712 00000100:00100000:3.0:1788658666.453010:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658666.453017:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025299328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658666.453061:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025299328:12345-0@lo:400:kworker.0 Request processed in 45us (10203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658666.453067:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658666.453077:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788658666.453082:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025299712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658666.453102:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025299712:12345-0@lo:400:kworker.0 Request processed in 20us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658666.453107:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788658666.453141:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658666.453145:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658666.453147:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658666.453289:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788658666.456163:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025299328:0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.456210:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025299200 00000100:00100000:1.0:1788658666.456218:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025299200 00000100:00100000:1.0:1788658666.456274:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025299584 00000100:00100000:1.0:1788658666.456277:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025299584 00000100:00100000:1.0:1788658666.456297:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788658666.456305:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025299200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658666.456309:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788658666.456318:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025299584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.456472:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025299200:12345-0@lo:400:kworker.0 Request processed in 166us (5062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658666.456479:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788658666.456508:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025299072 00000100:00100000:1.0:1788658666.456512:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025299072 00000100:00100000:1.0:1788658666.456542:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788658666.456548:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3648:x1875544025299072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.456576:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3648:x1875544025299072:12345-0@lo:400:kworker.0 Request processed in 29us (4491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658666.456581:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788658666.456628:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025299072:0@lo:400:kworker.0 00010000:00080000:1.0:1788658666.456976:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d54000 x1875544025300096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658666.457001:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025300096:0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.457016:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025299200:0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.457027:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025299712:0@lo:400:kworker.0 00000100:00100000:1.0:1788658666.457040:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025300224:0@lo:400:kworker.0 00000100:00100000:3.0:1788658666.469686:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025299584:12345-0@lo:400:kworker.0 Request processed in 13357us (17540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658666.469717:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788658666.471078:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025299584:0@lo:400:kworker.0 00010000:00010000:0.0:1788658666.562464:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788658666.658297:0:20732:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788658666.677480:0:20732:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788658666.677539:0:20732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658666.677556:0:20732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658666.677564:0:20732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658666.677571:0:20732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658666.677595:0:20732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788658666.677601:0:20732:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788658666.677636:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658666.677640:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788658666.677646:0:20732:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788658666.677681:0:20732:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3230800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788658666.677784:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658666.677793:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.677801:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97e00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658666.677805:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.677816:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658666.677823:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658666.677829:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788658666.677832:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788658666.677834:0:17150:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788658666.677860:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.677866:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658666.677910:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.677918:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.677931:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658666.677933:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658666.677935:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658666.677942:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658666.677960:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025300608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658666.678034:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658666.678091:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025300608 00000100:00100000:1.0:1788658666.678097:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025300608 00000100:00100000:1.0:1788658666.678147:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658666.678155:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3649:x1875544025300608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658666.678169:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658666.678183:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83418c00/0x48e67cc629c6fa89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6fa82 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.678199:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658666.678240:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:3649:x1875544025300608:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658666.678247:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658666.678290:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025300608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658666.681690:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025300480:0@lo:39:umount.0 00000100:00100000:2.0:1788658666.681795:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658666.685884:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025300480 00000100:00100000:1.0:1788658666.685902:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025300480 00000100:00100000:1.0:1788658666.685986:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788658666.685997:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875544025300480:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788658666.686051:0:20300:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fab3 00000100:00080000:1.0:1788658666.686065:0:20300:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1215000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788658666.686202:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1875544025300480:12345-0@lo:39:umount.0 Request processed in 206us (4406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658666.686209:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000020:00000080:1.0:1788658666.686223:0:20300:0:(genops.c:885:class_export_put()) final put ffff8a1ec1217000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788658666.687962:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788658666.687983:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1217000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788658666.688070:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ec1215000 for lustre-MDT0000 00000100:00080000:2.0:1788658666.691698:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3230800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788658666.691765:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025300480:0@lo:39:umount.0 00000100:00080000:1.0:1788658666.692033:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788658666.692038:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788658666.692043:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788658666.693441:0:20732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.693464:0:20732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.693472:0:20732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.693480:0:20732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.693552:0:20732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658666.693561:0:20732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.693568:0:20732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.693582:0:20732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.693587:0:20732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658666.695023:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658666.695036:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658666.695046:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418600 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658666.695050:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658666.695078:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658666.695084:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658666.695090:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658666.695092:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788658666.695131:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658666.695136:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788658666.695203:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1788658666.695222:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658666.695230:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658666.695246:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658666.695249:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658666.695255:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390800 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658666.695258:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658666.695265:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658666.695270:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658666.695282:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658666.695284:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788658666.695297:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658666.695302:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788658666.695342:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025300864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658666.695416:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658666.695469:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025300736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658666.695494:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658666.695526:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025300864 00000100:00100000:2.0:1788658666.695527:0:18316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025300736 00000100:00100000:2.0:1788658666.695533:0:18316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025300736 00000100:00100000:0.0:1788658666.695533:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025300864 00010000:00010000:3.0:1788658666.695578:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658666.695587:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658666.695589:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658666.695590:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658666.695599:0:20732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788658666.695606:0:20732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658666.695616:0:20732:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788658666.695630:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658666.695640:0:20732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.695648:0:20732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.695655:0:20732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.695673:0:20732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.695721:0:20732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788658666.695721:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788658666.695729:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658666.695732:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658666.695732:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3648:x1875544025300864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658666.695747:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658666.695749:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391c00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658666.695751:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.695757:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658666.695760:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83419600/0x48e67cc629c6fded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6fde6 expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658666.695764:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658666.695769:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788658666.695771:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788658666.695773:0:17150:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788658666.695773:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658666.695786:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.695792:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788658666.695802:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:3648:x1875544025300864:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (386us total) trans 0 rc 0/0 00010000:00010000:1.0:1788658666.695807:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658666.695808:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788658666.695813:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.695821:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658666.695822:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658666.695824:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658666.695833:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025300992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658666.695846:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658666.695852:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eabc42c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:3648:x1875544025300736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658666.695859:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788658666.695867:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658666.695868:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81671a00/0x48e67cc629c6f9da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6f9d3 expref: 22 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658666.695877:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658666.695895:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eabc42c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3648:x1875544025300736:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658666.695901:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788658666.697096:0:20732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.697130:0:20732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.697137:0:20732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.697144:0:20732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.697166:0:20732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788658666.697172:0:20732:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788658666.697177:0:20732:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788658666.697221:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658666.697227:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.697564:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658666.697568:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.697579:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658666.697587:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658666.697594:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788658666.697596:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788658666.697599:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788658666.697648:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.697656:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658666.697686:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.697694:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658666.697733:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658666.697736:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658666.697739:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658666.697750:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658666.697767:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025301120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658666.697848:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658666.699889:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025300992 00000100:00100000:0.0:1788658666.699909:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025300992 00000100:00100000:0.0:1788658666.699978:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658666.699989:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3649:x1875544025300992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658666.700005:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658666.700025:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ebf602200/0x48e67cc629c6ff8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6ff83 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658666.700064:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658666.700137:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:3649:x1875544025300992:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (4268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658666.700145:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658666.700210:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025300864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658666.700222:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025300736:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1788658666.701182:0:20732:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788658666.701189:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788658666.701196:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658666.701203:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788658666.701210:0:20732:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a1d810f5000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658666.701217:0:20732:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a1d832d7000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658666.701222:0:20732:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a1d8345a800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658666.701225:0:20732:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a1e840ed800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658666.701232:0:20732:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8a1ebf635800 dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 192.168.202.53@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934597 stale:0 00000020:00080000:0.0:1788658666.701238:0:20732:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8a1e840a7000 f934723f-b66d-409a-bfc9-9b206b383163 192.168.202.53@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934622 stale:0 00000020:00080000:0.0:1788658666.701243:0:20732:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a1d82778000) has exports, disconnecting them 00000020:00080000:0.0:1788658666.701248:0:20732:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a1d810f5000), last request at 1788658666 00000020:00000080:0.0:1788658666.701254:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fdb5 00000100:00080000:0.0:1788658666.701272:0:20732:0:(import.c:65:import_set_state_nolock()) ffff8a1d810f1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788658666.701339:0:20732:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d810f5000): rc 0 00000020:00000080:0.0:1788658666.701342:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1d810f5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788658666.701355:0:20732:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a1d832d7000), last request at 1788658666 00000020:00000080:0.0:1788658666.701370:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fc50 00000100:00080000:0.0:1788658666.701375:0:20732:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d0800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788658666.701388:0:20732:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d832d7000): rc 0 00000020:00000080:0.0:1788658666.701390:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1d832d7000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788658666.701394:0:20732:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a1d8345a800), last request at 1788658591 00000020:00000080:0.0:1788658666.701397:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fba1 00000100:00080000:0.0:1788658666.701400:0:20732:0:(import.c:65:import_set_state_nolock()) ffff8a1d8345c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788658666.701405:0:20732:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d8345a800): rc 0 00000020:00000080:0.0:1788658666.701406:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1d8345a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788658666.701409:0:20732:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a1e840ed800), last request at 1788658591 00010000:00010000:3.0:1788658666.701498:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788658666.701573:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fb46 00000100:00080000:0.0:1788658666.701577:0:20732:0:(import.c:65:import_set_state_nolock()) ffff8a1e840eb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658666.701625:0:20732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00080000:0.0:1788658666.701754:0:20732:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1e840ed800): rc 0 00000004:00000080:0.0:1788658666.701761:0:20732:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa33e47dd7ae0 00000100:00080000:0.0:1788658666.701784:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788658666.701787:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788658666.703319:0:20732:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788658666.703359:0:20732:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788658666.703474:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025301248:0@lo:39:umount.0 00010000:00010000:3.0:1788658666.703551:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658666.703555:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658666.703591:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025301248 00000100:00100000:3.0:1788658666.703599:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025301248 00000020:00000080:3.0:1788658666.703735:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d810f5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788658666.703788:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d832d7000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1788658666.703816:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000020:00000080:3.0:1788658666.703817:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d8345a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1788658666.703827:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875544025301248:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788658666.703859:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d810f1000 for lustre-MDT0000 00000020:00000080:3.0:1788658666.703865:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d832d0800 for lustre-MDT0000 00000020:00000080:3.0:1788658666.703869:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d8345c000 for lustre-MDT0000 00010000:00010000:3.0:1788658666.703880:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658666.704085:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788658666.704090:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788658666.704106:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788658666.704163:0:20732:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788658666.704177:0:20732:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3234000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788658666.704187:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788658666.704189:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788658666.704197:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788658666.704255:0:20732:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788658666.704264:0:20732:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788658666.704327:0:20732:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a1d82778000) has no exports 00000100:00100000:1.0:1788658666.704862:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025300992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658666.705257:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025301120 00000100:00100000:0.0:1788658666.705264:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025301120 00000100:00100000:0.0:1788658666.705323:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788658666.705331:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:3649:x1875544025301120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658666.705344:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658666.705362:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81671800/0x48e67cc629c6f9cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6f9c5 expref: 20 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658666.705378:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658666.705426:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:3649:x1875544025301120:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (7590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658666.705432:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658666.705560:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025301120:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788658666.705891:0:17167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fbcb 00000100:00080000:2.0:1788658666.706100:0:17167:0:(import.c:65:import_set_state_nolock()) ffff8a1eb5e63000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658666.706134:0:17167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788658666.706280:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3646:x1875544025301248:12345-0@lo:39:umount.0 Request processed in 2454us (2723us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788658666.706289:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788658666.706324:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025301376:0@lo:9:umount.0 00000100:00100000:2.0:1788658666.706362:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658666.706385:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025301504:0@lo:9:umount.0 00000100:00100000:2.0:1788658666.706408:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788658666.706441:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788658666.706448:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025301248:0@lo:39:umount.0 00000100:00100000:2.0:1788658666.706470:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025301376 00000100:00100000:2.0:1788658666.706490:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025301376 00000100:00100000:2.0:1788658666.706523:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025301504 00000100:00100000:2.0:1788658666.706525:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025301504 00000100:00100000:2.0:1788658666.706544:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658666.706551:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875544025301376:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788658666.706569:0:18667:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fc96 00000100:00080000:2.0:1788658666.706574:0:18667:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658666.706610:0:18667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788658666.706744:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3646:x1875544025301376:12345-0@lo:9:umount.0 Request processed in 192us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658666.706750:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658666.706763:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658666.706769:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875544025301504:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788658666.706781:0:18667:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fdf4 00000100:00080000:2.0:1788658666.706786:0:18667:0:(import.c:65:import_set_state_nolock()) ffff8a1d831d2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658666.706802:0:18667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788658666.706966:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3646:x1875544025301504:12345-0@lo:9:umount.0 Request processed in 197us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658666.706973:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788658666.706995:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788658666.707014:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3234000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788658666.707026:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788658666.707027:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658666.707030:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025301376:0@lo:9:umount.0 00000100:00080000:2.0:1788658666.707041:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788658666.707048:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788658666.707049:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658666.707052:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025301504:0@lo:9:umount.0 00010000:00010000:3.0:1788658666.707262:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788658666.719239:0:20732:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a1d82778000) has no exports 00000020:00000080:3.0:1788658666.830159:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fa20 00000020:00000080:3.0:1788658666.830182:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1e917e8000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788658666.830209:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788658666.830408:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e917e8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788658666.830535:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658666.830549:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788658666.830555:0:20732:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a1ebd884d40) has no exports 00000020:00000080:0.0:1788658666.832196:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fa19 00000020:00000080:0.0:1788658666.832208:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1e840e8800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788658666.832265:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658666.832277:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788658666.832279:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1d844d4000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788658666.832282:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d844d4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788658666.832293:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788658666.832473:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e840e8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788658667.455380:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658667.455407:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025301632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658667.455499:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658667.455740:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025301632 00000100:00100000:1.0:1788658667.455750:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025301632 00000100:00100000:1.0:1788658667.455806:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788658667.455816:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025301632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658667.455845:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788658667.455903:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025301632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658667.455910:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658667.457073:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025301632:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788658667.583110:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788658667.982382:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658667.982417:0:18664:0:(genops.c:885:class_export_put()) final put ffff8a1d832d4000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788658667.982461:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f934723f-b66d-409a-bfc9-9b206b383163 00000020:00000080:1.0:1788658667.982465:0:18664:0:(genops.c:885:class_export_put()) final put ffff8a1d832d3800/f934723f-b66d-409a-bfc9-9b206b383163 00000020:00000080:3.0:1788658667.982545:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d832d4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788658667.982743:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d832d3800/f934723f-b66d-409a-bfc9-9b206b383163 for lustre-OST0000 00000020:00000080:3.0:1788658667.982798:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d832d2000 for lustre-OST0000 00000020:00000080:3.0:1788658667.982809:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ec1212000 for lustre-OST0000 00000001:00100000:0.0:1788658667.990542:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788658667.990557:0:17142:0:(genops.c:885:class_export_put()) final put ffff8a1e840ed800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788658667.990596:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000001:00080000:0.0:1788658667.990611:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1788658667.990615:0:17142:0:(genops.c:885:class_export_put()) final put ffff8a1ebf635800/dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000001:00100000:0.0:1788658667.990621:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f934723f-b66d-409a-bfc9-9b206b383163 00000001:00080000:0.0:1788658667.990649:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:0.0:1788658667.990656:0:17142:0:(genops.c:885:class_export_put()) final put ffff8a1e840a7000/f934723f-b66d-409a-bfc9-9b206b383163 00000020:00000080:3.0:1788658667.990683:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e840ed800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788658667.990811:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebf635800/dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad for lustre-MDT0000 00000020:00000080:3.0:1788658667.990848:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e840a7000/f934723f-b66d-409a-bfc9-9b206b383163 for lustre-MDT0000 00000020:00000080:3.0:1788658667.990888:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1e840eb800 for lustre-MDT0000 00000020:00000080:3.0:1788658667.990893:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ebf633800 for lustre-MDT0000 00000020:00000080:3.0:1788658667.990896:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1e840a2800 for lustre-MDT0000 00010000:00010000:3.0:1788658668.607121:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788658668.863840:0:20732:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1e98a7b420 - data ffff8a1d81cdda20/ffff8a1eb1cd8800 00000020:01000000:0.0:1788658668.864077:0:20732:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1eadbb9000 - data ffff8a1e9ef21ca8/ffff8a1ebf6c0800 00000001:00000004:0.0:1788658668.874000:0:20732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:3.0:1788658668.965248:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788658668.965261:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788658668.965285:0:20732:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a1ebdb90a80 x1875544025301248/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788658676 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658668.965322:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788658668.975475:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788658668.975486:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1788658668.975504:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658668.975507:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788658668.976206:0:17186:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788658668.976215:0:17186:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1788658668.976230:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788658668.977245:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788658668.977254:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1788658668.977274:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658668.977277:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788658668.978283:0:17188:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788658668.978291:0:17188:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1788658668.978302:0:17188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788658668.985292:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6f9e8 00000020:00000080:0.0:1788658668.985311:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb740b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788658668.985837:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb740b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1788658668.990990:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025301760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658668.992218:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658668.994055:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025301760 00000100:00100000:0.0:1788658668.994074:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025301760 00000100:00100000:0.0:1788658668.995262:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788658668.995997:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875544025301760:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788658668.996013:0:18107:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788658668.996135:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875544025301760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (3927us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788658668.996143:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:02020000:0.0:1788658668.996239:0:3648:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000020:00000080:3.0:1788658668.999196:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6f9fd 00000020:00000080:3.0:1788658668.999213:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb2139000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788658668.999232:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788658668.999240:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658668.999252:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788658668.999257:0:20732:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a1d8277cd40) has no exports 00000004:01000000:3.0:1788658668.999479:0:20732:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788658668.999491:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fa5f 00000020:00000080:3.0:1788658668.999496:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1ebdb60000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788658668.999501:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788658668.999505:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658668.999511:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788658668.999514:0:20732:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8a1d821b99c0) has no exports 00000020:00000080:3.0:1788658668.999523:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fa58 00000020:00000080:3.0:1788658668.999527:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb3233000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788658669.000008:0:20732:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788658669.000015:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788658669.000020:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788658669.000028:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788658669.000031:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788658669.000069:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658669.000076:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788658669.000083:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fa4a 00000020:00000080:3.0:1788658669.000089:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1e84e4b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788658669.000093:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788658669.000097:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658669.000101:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788658669.000104:0:20732:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8a1eb23f3380) has no exports 00000020:00000080:3.0:1788658669.000108:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fa43 00000020:00000080:3.0:1788658669.000112:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb3231000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788658669.000501:0:20732:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788658669.000505:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788658669.000507:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1788658669.000511:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788658669.000513:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788658669.000539:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658669.000544:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788658669.000556:0:20732:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788658669.000561:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fa35 00000020:00000080:3.0:1788658669.000567:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb3237800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788658669.000571:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788658669.000575:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658669.000578:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788658669.000580:0:20732:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8a1ebf43b380) has no exports 00000020:00000080:3.0:1788658669.000584:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fa2e 00000020:00000080:3.0:1788658669.000586:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb213a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788658669.001267:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb2139000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788658669.001282:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdb60000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788658669.001289:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb3233000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788658669.001295:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb3235800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788658669.001304:0:8:0:(genops.c:885:class_export_put()) final put ffff8a1e84e4e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658669.001307:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e84e4e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788658669.001311:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658669.001426:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e84e4b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788658669.001432:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb3231000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788658669.001436:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb3234000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788658669.001442:0:8:0:(genops.c:885:class_export_put()) final put ffff8a1eb3232800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658669.001445:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb3232800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788658669.001448:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658669.001478:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb3237800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788658669.001482:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb213a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:1.0:1788658669.014083:0:17894:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788658669.014105:0:17894:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1788658669.014129:0:17894:0:(genops.c:885:class_export_put()) final put ffff8a1e86de7800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788658669.014149:0:17894:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000001:00080000:1.0:1788658669.014155:0:17894:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1788658669.014157:0:17894:0:(genops.c:885:class_export_put()) final put ffff8a1d810f0800/dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000001:00100000:1.0:1788658669.014164:0:17894:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f934723f-b66d-409a-bfc9-9b206b383163 00000001:00080000:1.0:1788658669.014168:0:17894:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1788658669.014169:0:17894:0:(genops.c:885:class_export_put()) final put ffff8a1e840a0800/f934723f-b66d-409a-bfc9-9b206b383163 00000020:00000080:1.0:1788658669.014185:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e86de7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788658669.014265:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d810f0800/dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad for lustre-MDT0001 00000020:00000080:1.0:1788658669.014295:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e840a0800/f934723f-b66d-409a-bfc9-9b206b383163 for lustre-MDT0001 00000020:00000080:1.0:1788658669.014326:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb5e63000 for lustre-MDT0001 00000020:00000080:1.0:1788658669.014331:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d810f2000 for lustre-MDT0001 00000020:00000080:1.0:1788658669.014335:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d832d1000 for lustre-MDT0001 00000100:00080000:0.0:1788658669.023179:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788658669.023190:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a1d83706800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788658669.023220:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788658669.043965:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a1d83706800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658669.043986:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1788658669.044001:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a1d83706800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658669.045627:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834e4380 x1875544025301888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658669.045740:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025301888:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788658669.045830:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658669.045968:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025301888 00000100:00100000:0.0:1788658669.045979:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025301888 00000100:00100000:0.0:1788658669.046036:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788658669.046044:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025301888:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788658669.046062:0:17167:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788658669.061674:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025301888:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 15618us (15833us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788658669.061690:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788658669.061784:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d83706800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658669.061791:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788658669.061795:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025301888:0@lo:38:ptlrpcd_00_01.0 00010000:01000000:1.0:1788658669.096815:0:20732:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788658669.096830:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788658669.096837:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788658669.096851:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788658669.096932:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb213e800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788658669.096947:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658669.096966:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658669.097000:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb213d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658669.097005:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb213d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788658669.097021:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658669.097194:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658669.097199:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658669.097203:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb7408800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658669.097205:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb7408800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788658669.097210:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658669.097287:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fa04 00000020:00000080:1.0:1788658669.097297:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb2139800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788658669.097316:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788658669.097323:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658669.097330:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788658669.097334:0:20732:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a1d8277b380) has no exports 00000020:00000080:1.0:1788658669.097361:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658669.097365:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788658669.097367:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb2139800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788658669.097370:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fa0b 00000020:00000080:0.0:1788658669.097371:0:36:0:(genops.c:885:class_export_put()) final put ffff8a1eb213f800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788658669.097373:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb213f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788658669.097374:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb213c800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788658669.097382:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788658669.097409:0:20732:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1eb751f000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788658669.097413:0:20732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1eb751f000 3 00000020:01000004:1.0:1788658669.097417:0:20732:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1eb751f000 from lustre-MDT0000 00000020:00000080:1.0:1788658669.097456:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658669.097460:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788658669.097463:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb740e800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788658669.097465:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb740e800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788658669.097473:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:0.0:1788658669.097490:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb213c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1788658669.097502:0:20732:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788658669.097507:0:20732:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788658669.097510:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788658669.097513:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658669.097516:0:20732:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788658669.097524:0:20732:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a1eb740d000 913293d7-fe00-4834-a4c1-1b0cae17d59a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788658669.097536:0:20732:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a1d827799c0) has exports, disconnecting them 00000020:00080000:1.0:1788658669.097541:0:20732:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a1eb740d000), last request at 1788658577 00000020:00000080:1.0:1788658669.097561:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6f9b0 00000020:00010000:1.0:1788658669.097566:0:20732:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a1eb740d000: total 0 00000100:00080000:1.0:1788658669.097571:0:20732:0:(import.c:65:import_set_state_nolock()) ffff8a1eb740f800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788658669.097593:0:20732:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1eb740d000): rc 0 00000020:00080000:1.0:1788658669.097598:0:20732:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a1d827799c0) has no exports 00000020:00010000:0.0:1788658669.097624:0:17151:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a1eb740d000: total 0 00010000:00010000:0.0:1788658669.097653:0:17151:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a1eb740d000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788658669.097695:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fc11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6fc0a expref: 14 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658669.097718:0:17156:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a1e8f2bb200:17156] 1 exiting: rc = 0 00010000:00010000:0.0:1788658669.097732:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6ff75 expref: 13 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097744:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec2045e00/0x48e67cc629c6fda0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6fd99 expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097768:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6fdd8 expref: 11 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097784:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d834a0c00/0x48e67cc629c6f9be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6f9b7 expref: 10 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097794:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ebf603e00/0x48e67cc629c6ff59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6ff52 expref: 9 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097805:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81670800/0x48e67cc629c6facf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6fac8 expref: 8 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097818:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec2045200/0x48e67cc629c6fc3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6fc34 expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097828:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83418a00/0x48e67cc629c6ff67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6ff60 expref: 6 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097911:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fb8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6fb85 expref: 5 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097929:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c6fadd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6fad6 expref: 4 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097943:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81671e00/0x48e67cc629c6faeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6fae4 expref: 3 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097954:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96800/0x48e67cc629c6fd76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6fd6f expref: 2 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658669.097977:0:17151:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a1eb740d000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788658669.097996:0:17151:0:(genops.c:885:class_export_put()) final put ffff8a1eb740d000/913293d7-fe00-4834-a4c1-1b0cae17d59a 00010000:00010000:0.0:1788658669.098026:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658669.098029:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658669.098031:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788658669.098125:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb740d000/913293d7-fe00-4834-a4c1-1b0cae17d59a for MGS 00000020:00000080:1.0:1788658669.098158:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb740f800 for MGS 00000100:00100000:2.0:1788658669.099637:0:17157:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a1e8f2ba600:17157] 2 exiting: rc = 0 00000100:00100000:3.0:1788658669.100725:0:17154:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a1e82e17000:17154] 0 exiting: rc = 1 00000100:00100000:1.0:1788658669.100977:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.100989:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.100997:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.101004:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.101011:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.101018:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.101025:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.101032:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.101039:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.102814:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.102832:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.102838:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.103930:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.103944:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.103951:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.103957:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.103965:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.103972:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.103978:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.103985:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.103991:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.103998:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104025:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104031:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104037:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104128:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104138:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104145:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104151:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104159:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104167:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104174:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104180:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104187:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104195:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104201:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104208:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104214:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104219:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104225:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104240:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104246:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104252:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104257:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104269:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104929:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104937:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104949:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104958:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104968:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104974:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104982:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104989:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.104995:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.105001:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.105008:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.105015:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.105035:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.105040:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.106132:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.106150:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.106157:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.106163:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658669.106169:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788658669.111500:0:20732:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1e98a7b5a0 - data ffff8a1d81c26510/ffff8a1eb1cd8c00 00000020:01000000:0.0:1788658669.111676:0:20732:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1d8315fba0 - data ffff8a1d81cb35e8/ffff8a1e915a9400 00000020:00000080:0.0:1788658669.112752:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6f994 00000020:00000080:0.0:1788658669.112768:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb740c000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788658669.112792:0:20732:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1eb751f000 from MGS, refs=2 00000020:01000004:0.0:1788658669.112797:0:20732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1eb751f000 2 00000020:01000004:0.0:1788658669.112800:0:20732:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1eb751f000 from MGS 00000020:00000080:0.0:1788658669.112827:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658669.112836:0:20732:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788658669.112840:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb740e000/MGS 00000020:00000080:1.0:1788658669.112946:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb740c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788658669.113456:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb740e000/MGS for MGS 00000020:01000000:0.0:1788658669.113467:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788658669.113585:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788658669.113590:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658669.113599:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788658669.113610:0:20732:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a1ebdb66800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658669.113618:0:20732:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8a1d821bb380) has exports, disconnecting them 00000020:00080000:0.0:1788658669.113626:0:20732:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a1ebdb66800), last request at 1788658578 00000020:00000080:0.0:1788658669.113632:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fa97 00000020:00080000:0.0:1788658669.113650:0:20732:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1ebdb66800): rc 0 00000020:00000080:0.0:1788658669.113656:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1ebdb66800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788658669.114923:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdb66800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788658669.117765:0:20732:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788658669.117778:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788658669.117784:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788658669.117796:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788658669.117839:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb3230800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788658669.118146:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658669.118158:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788658669.118165:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1ebdb62000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788658669.118169:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdb62000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788658669.118179:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788658669.118307:0:20732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1eb751f000 1 00000020:00000080:1.0:1788658669.118315:0:20732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6f986 00000020:00000080:1.0:1788658669.118324:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb7408000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788658669.118335:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788658669.118345:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb7408000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788658669.118356:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658669.118362:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788658669.118366:0:20732:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a1d821bcd40) has no exports 00000020:00000080:1.0:1788658669.265028:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658669.265048:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788658669.265058:0:20732:0:(genops.c:885:class_export_put()) final put ffff8a1eb751e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788658669.265065:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb751e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788658669.265096:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788658669.265273:0:20732:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a1eb751d800 00000020:02000400:1.0:1788658669.265500:0:20732:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788658669.633134:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658670.656912:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658671.551077:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025302016:0@lo:400:kworker.0 00000400:00000100:1.0:1788658671.551143:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875544025302016 offset 0 length 224: 4 00000100:00080000:0.0:1788658671.551223:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658671.551228:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788658671.551249:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1d83706800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658671.551256:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 586 00000100:00080000:0.0:1788658671.551270:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788658671.551279:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a1d83706800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658671.551306:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb9b100 x1875544025302144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658671.551352:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025302272:0@lo:400:kworker.0 00000100:00100000:3.0:1788658671.551376:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025302144:0@lo:38:kworker.0 00000100:00100000:2.0:1788658671.551397:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658671.551585:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025302272 00000100:00100000:2.0:1788658671.551594:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025302272 00000100:00100000:2.0:1788658671.551783:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658671.551795:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025302272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658671.552558:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788658671.552622:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658671.552640:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025302144 00000100:00100000:3.0:1788658671.552647:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025302144 00000100:00100000:3.0:1788658671.552684:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788658671.552691:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875544025302144:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788658671.552731:0:17168:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788658671.559993:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025302272:12345-0@lo:400:kworker.0 Request processed in 8187us (8582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658671.560012:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658671.560139:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025302272:0@lo:400:kworker.0 00000100:00100000:0.0:1788658671.560598:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025302528:0@lo:400:kworker.0 00000100:00100000:0.0:1788658671.560651:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658671.560689:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025303040:0@lo:400:kworker.0 00000100:00100000:0.0:1788658671.560732:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658671.560759:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788658671.560765:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025302400:0@lo:400:kworker.0 00000100:00100000:0.0:1788658671.560790:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658671.560808:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025302912:0@lo:400:kworker.0 00000100:00100000:0.0:1788658671.560830:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658671.560860:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025302528 00000100:00100000:0.0:1788658671.560869:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025302528 00000100:00100000:0.0:1788658671.560915:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025303040 00000100:00100000:0.0:1788658671.560918:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025303040 00000100:00100000:0.0:1788658671.560957:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025302912 00000100:00100000:0.0:1788658671.560960:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025302912 00000100:00100000:0.0:1788658671.560972:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788658671.560982:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025303040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658671.561037:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025303040:12345-0@lo:400:kworker.0 Request processed in 58us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658671.561044:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788658671.561076:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788658671.561080:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875544025302528:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788658671.561087:0:17164:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788658671.561128:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875544025302528:12345-0@lo:400:kworker.0 Request processed in 47us (478us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788658671.561135:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788658671.561147:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788658671.561150:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875544025302912:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788658671.561154:0:17164:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788658671.561175:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875544025302912:12345-0@lo:400:kworker.0 Request processed in 23us (345us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788658671.561180:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788658671.561198:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025302400 00000100:00100000:0.0:1788658671.561201:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025302400 00000100:00100000:0.0:1788658671.561231:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788658671.561237:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025302400:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788658671.561655:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658671.561663:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788658671.561687:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025302656:0@lo:400:kworker.0 00000100:00100000:1.0:1788658671.563525:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658671.563576:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025303168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658671.563609:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658671.563640:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658671.563645:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025302784:0@lo:400:kworker.0 00000100:00100000:1.0:1788658671.563660:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658671.563693:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025303168 00000100:00100000:1.0:1788658671.563699:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025303168 00000100:00100000:1.0:1788658671.563751:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658671.563758:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875544025303168:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658671.563771:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025302656 00000100:00100000:2.0:1788658671.563778:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025302656 00002000:00000024:1.0:1788658671.563783:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788658671.563807:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025302784 00000100:00100000:2.0:1788658671.563812:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025302784 00000100:00100000:1.0:1788658671.563820:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875544025303168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658671.563825:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788658671.563848:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788658671.563857:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025302784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658671.563904:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025302400:12345-0@lo:400:kworker.0 Request processed in 2666us (3111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658671.563906:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025302784:12345-0@lo:400:kworker.0 Request processed in 49us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658671.563914:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788658671.563956:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788658671.563960:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875544025302656:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788658671.563964:0:20300:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788658671.563999:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875544025302656:12345-0@lo:400:kworker.0 Request processed in 37us (481us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788658671.564003:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788658671.564023:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788658671.564047:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a1eb1c95500 x1875544025302784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658671.564057:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025302784:0@lo:400:kworker.0 00000100:00080000:1.0:1788658671.564064:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788658671.564068:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788658671.564071:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788658671.564076:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658671.564078:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 527 00000100:00080000:1.0:1788658671.564082:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a1d832d5000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658671.564116:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83d57800 x1875544025303296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658671.564137:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025302656:0@lo:400:kworker.0 00000100:00100000:1.0:1788658671.564157:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025303168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658671.564184:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025303296:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788658671.564201:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658671.564218:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025303296 00000100:00100000:1.0:1788658671.564220:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025303296 00000100:00100000:1.0:1788658671.564232:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788658671.564236:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1875544025303296:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788658671.564255:0:20300:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788658671.564770:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1875544025303296:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 531us (565us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788658671.564778:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788658671.564814:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658671.564818:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788658671.564821:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025303296:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788658671.564881:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025302400:0@lo:400:kworker.0 00000100:00080000:1.0:1788658671.564894:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788658671.564898:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a1e92f80800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788658671.564901:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788658671.564904:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a1e92f80800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658671.564908:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 542 00000100:00080000:1.0:1788658671.564913:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a1e92f80800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658671.564931:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83d57800 x1875544025303424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658671.564947:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025302912:0@lo:400:kworker.0 00000100:00080000:1.0:1788658671.564963:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788658671.564966:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a1e88e5f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788658671.564968:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788658671.564971:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a1e88e5f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658671.564973:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 509 00000100:00080000:1.0:1788658671.564976:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a1e88e5f800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658671.564997:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83d56300 x1875544025303552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658671.565007:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025302528:0@lo:400:kworker.0 00010000:00080000:1.0:1788658671.565022:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a1eb1c96d80 x1875544025303040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658671.565030:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025303040:0@lo:400:kworker.0 00000100:00100000:1.0:1788658671.565059:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025303424:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788658671.565088:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658671.565121:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875544025303552:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788658671.565141:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658671.565169:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025303424 00000100:00100000:1.0:1788658671.565173:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025303424 00000100:00100000:1.0:1788658671.565190:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025303552 00000100:00100000:1.0:1788658671.565192:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025303552 00000100:00100000:1.0:1788658671.565203:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788658671.565208:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875544025303424:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788658671.565223:0:17163:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788658671.565254:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875544025303424:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 44us (165us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788658671.565260:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788658671.566728:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788658671.566740:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875544025303552:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788658671.566761:0:17163:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788658671.566831:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875544025303552:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 91us (1688us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788658671.566855:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788658671.566912:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e92f80800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658671.566918:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788658671.566922:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025303424:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1788658671.566934:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e88e5f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658671.566938:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788658671.566941:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875544025303552:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788658671.568574:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788658671.582372:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875544025302144:12345-0@lo:38:kworker.0 Request processed in 29669us (29805us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788658671.582401:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788658671.584536:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d83706800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658671.584549:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788658671.584554:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025302144:0@lo:38:kworker.0 00010000:00010000:1.0:1788658671.691535:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658672.575604:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025303680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658672.575672:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658672.575757:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025303680 00000100:00100000:3.0:1788658672.575765:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025303680 00000100:00100000:3.0:1788658672.575807:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788658672.575816:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025303680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788658672.575851:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788658672.575893:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025303680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658672.575900:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788658672.575950:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025303680:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788658672.577146:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788658672.577154:0:19484:0:(genops.c:885:class_export_put()) final put ffff8a1d831d7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788658672.578100:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d831d7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788658672.578158:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d831d2800 for lustre-OST0001 00010000:00010000:1.0:1788658672.702798:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788658673.324876:0:20933:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788658673.341863:0:20933:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788658673.341929:0:20933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.341948:0:20933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.341977:0:20933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.341984:0:20933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.342013:0:20933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788658673.342019:0:20933:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788658673.342058:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658673.342063:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788658673.342070:0:20933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788658673.342077:0:20933:0:(import.c:65:import_set_state_nolock()) ffff8a1e88e5f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788658673.342082:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658673.342084:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788658673.342087:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788658673.342109:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658673.342117:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.342125:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97800 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658673.342130:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.342141:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658673.342149:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658673.342155:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788658673.342165:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788658673.342168:0:17150:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788658673.342211:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.342218:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658673.342249:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.342257:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.342279:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658673.342281:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658673.342282:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658673.342975:0:20933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.342986:0:20933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.342993:0:20933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343000:0:20933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343021:0:20933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658673.343038:0:20933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343045:0:20933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343051:0:20933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343057:0:20933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343073:0:20933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788658673.343085:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658673.343089:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343095:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658673.343098:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343106:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658673.343112:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658673.343118:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658673.343120:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788658673.343139:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343153:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658673.343162:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343168:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343179:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658673.343182:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343187:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390e00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658673.343190:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343198:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658673.343204:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658673.343208:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658673.343210:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788658673.343212:0:17150:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788658673.343222:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343227:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658673.343239:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343253:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343281:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658673.343283:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658673.343284:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658673.343297:0:20933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.343302:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658673.343305:0:20933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343311:0:20933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343317:0:20933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343336:0:20933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658673.343343:0:20933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343349:0:20933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343356:0:20933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.343361:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658673.343363:0:20933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.343365:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.343372:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658673.343375:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343380:0:20933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658673.343383:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658673.343384:0:20933:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788658673.343387:0:20933:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 10000000:00010000:1.0:1788658673.343400:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658673.343406:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788658673.343414:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788658673.343415:0:17150:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788658673.343431:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658673.343432:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.343437:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658673.343443:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.343449:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658673.343458:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658673.343460:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658673.343462:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788658673.343554:0:20933:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788658673.343559:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788658673.343564:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658673.343570:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788658673.343579:0:20933:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8a1d810f7800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658673.343584:0:20933:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8a1eb213b800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658673.343589:0:20933:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8a1ebd880000) has exports, disconnecting them 00000020:00080000:0.0:1788658673.343594:0:20933:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a1d810f7800), last request at 1788658671 00000020:00000080:0.0:1788658673.343601:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fdca 00000100:00080000:0.0:1788658673.343618:0:20933:0:(import.c:65:import_set_state_nolock()) ffff8a1d810f6800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788658673.343671:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788658673.343684:0:20933:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d810f7800): rc 0 00000020:00000080:0.0:1788658673.343687:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1d810f7800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788658673.343697:0:20933:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a1eb213b800), last request at 1788658671 00000020:00000080:0.0:1788658673.343719:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fc65 00000100:00080000:0.0:1788658673.343726:0:20933:0:(import.c:65:import_set_state_nolock()) ffff8a1eabc57800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788658673.343740:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788658673.343740:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d810f7800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:1.0:1788658673.343742:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658673.343744:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788658673.343789:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d810f6800 for lustre-MDT0001 00010000:00010000:0.0:1788658673.343801:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343807:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658673.343810:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343823:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658673.343829:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658673.343833:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658673.343835:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788658673.343837:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788658673.343853:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343858:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658673.343863:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343869:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658673.343882:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658673.343883:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658673.343885:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658673.343890:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788658673.343899:0:20933:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1eb213b800): rc 0 00000020:00000080:0.0:1788658673.343901:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1eb213b800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788658673.343922:0:20933:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa33e4152fae0 00000100:00080000:0.0:1788658673.343943:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658673.343952:0:20933:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8a1eb7402a00 x1875544025301760/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788658684 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1788658673.343968:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb213b800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:0.0:1788658673.343972:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000020:00000080:1.0:1788658673.344002:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eabc57800 for lustre-MDT0001 00000100:00080000:0.0:1788658673.344834:0:20933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788658673.344841:0:20933:0:(import.c:65:import_set_state_nolock()) ffff8a1d83706800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1788658673.345056:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025303808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658673.345132:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658673.345186:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025304320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658673.345206:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658673.345232:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658673.345238:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025303936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658673.345256:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658673.345301:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025303808 00000100:00100000:2.0:1788658673.345307:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025303808 00000100:00100000:2.0:1788658673.345338:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025304320 00000100:00100000:2.0:1788658673.345341:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025304320 00000100:00100000:2.0:1788658673.345348:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025303936 00000100:00100000:2.0:1788658673.345350:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025303936 00000100:00100000:2.0:1788658673.345360:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658673.345368:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1875544025303808:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788658673.345374:0:17149:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788658673 with bad export cookie 5253023205920537008 00000100:00100000:3.0:1788658673.347446:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025301760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658673.347509:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025304064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658673.347577:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658673.347623:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658673.347630:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025304192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658673.347655:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658673.348792:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025304064 00000100:00100000:1.0:1788658673.348804:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025304064 00000100:00100000:1.0:1788658673.348839:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025304192 00000100:00100000:1.0:1788658673.348842:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025304192 00000100:00100000:1.0:1788658673.348874:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658673.348882:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875544025304320:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788658673.348889:0:17147:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788658673 with bad export cookie 5253023205920537008 00000100:00100000:1.0:1788658673.348972:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875544025304320:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (3763us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788658673.348980:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658673.348997:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788658673.349000:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788658673.349006:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a1d83d58800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788658673.349009:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.153@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788658673.349014:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875544025303936:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788658673.349018:0:17147:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788658673 with bad export cookie 5253023205920537008 00000100:00100000:1.0:1788658673.349045:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875544025303936:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (3788us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788658673.349050:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658673.349063:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658673.349066:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1875544025304064:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788658673.349070:0:17147:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788658673 with bad export cookie 5253023205920537008 00000100:00100000:1.0:1788658673.349103:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1875544025304064:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (1527us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788658673.349110:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658673.349122:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658673.349127:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eabc40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1875544025304192:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788658673.349131:0:17147:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788658673 with bad export cookie 5253023205920537008 00000100:00100000:1.0:1788658673.349155:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eabc40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1875544025304192:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (1499us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788658673.349161:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788658673.349763:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788658673.349768:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788658673.349791:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788658673.349854:0:20933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788658673.349878:0:20933:0:(import.c:65:import_set_state_nolock()) ffff8a1eb744b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788658673.349894:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788658673.349896:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788658673.349907:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788658673.349950:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025304448:0@lo:9:umount.0 00000100:00080000:0.0:1788658673.349969:0:20933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788658673.349978:0:20933:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788658673.349997:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788658673.350016:0:20933:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8a1ebd880000) has no exports 00000100:00100000:1.0:1788658673.350034:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025304576:0@lo:9:umount.0 00000100:00100000:1.0:1788658673.350056:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658673.354371:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025304448 00000100:00100000:0.0:1788658673.354388:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025304448 00000100:00100000:0.0:1788658673.354501:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025304576 00000100:00100000:0.0:1788658673.354506:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025304576 00000100:00100000:0.0:1788658673.354540:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788658673.354552:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875544025304448:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788658673.354586:0:19325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fc8f 00000100:00080000:0.0:1788658673.354597:0:19325:0:(import.c:65:import_set_state_nolock()) ffff8a1d8266b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658673.354643:0:19325:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788658673.354922:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3646:x1875544025304448:12345-0@lo:9:umount.0 Request processed in 371us (4923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658673.354930:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788658673.354951:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788658673.354977:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875544025304576:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788658673.354991:0:19325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fdfb 00000100:00080000:0.0:1788658673.354998:0:19325:0:(import.c:65:import_set_state_nolock()) ffff8a1eb4838000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658673.355023:0:19325:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788658673.355110:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3646:x1875544025304576:12345-0@lo:9:umount.0 Request processed in 134us (5052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658673.355116:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1788658673.355145:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658673.355180:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788658673.355192:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788658673.355195:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658673.355198:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025304576:0@lo:9:umount.0 00000100:00080000:0.0:1788658673.355210:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb744b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788658673.355219:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788658673.355220:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658673.355223:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025304448:0@lo:9:umount.0 00000100:00080000:1.0:1788658673.355671:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658673.355676:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788658673.355683:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658673.366346:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1875544025303808:12345-0@lo:103:ldlm_bl.0 Request processed in 20972us (21208us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788658673.366360:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788658673.366481:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788658673.408139:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.153@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788658673.408146:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788658673.408158:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d834e4380 x1875544025302016/t0(0) o400->MGC192.168.202.153@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788658687 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658673.408174:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d83d56300 x1875544025303808/t0(0) o103->MGC192.168.202.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788658689 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658673.408184:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb1c96d80 x1875544025304320/t0(0) o103->MGC192.168.202.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788658689 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658673.408193:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb1c94700 x1875544025303936/t0(0) o103->MGC192.168.202.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788658689 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658673.408200:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb1c94e00 x1875544025304064/t0(0) o103->MGC192.168.202.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788658689 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658673.408208:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d83d57800 x1875544025304192/t0(0) o103->MGC192.168.202.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788658689 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658673.408252:0:3649:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a1d83d58800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788658673.408295:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025304064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658673.408307:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025302016:0@lo:400:kworker.0 00000100:00100000:2.0:1788658673.408345:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025304192:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1788658673.409832:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788658673.409840:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788658673.409841:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788658673.409846:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a1d83d58800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658673.409854:0:3647:0:(import.c:545:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 494 00000100:00080000:3.0:1788658673.409882:0:3647:0:(import.c:665:import_select_connection()) MGC192.168.202.153@tcp: import ffff8a1d83d58800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658673.409915:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d81b3b480 x1875544025304704/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658673.409965:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025303936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658673.409972:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025303808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658673.409977:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025304320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658673.409978:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:913293d7-fe00-4834-a4c1-1b0cae17d59a:3646:1875544025304704:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788658673.410026:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875544025304704 offset 0 length 520: 4 00000020:00080000:0.0:1788658673.423891:0:20933:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8a1ebd880000) has no exports 00000020:01000000:0.0:1788658673.464329:0:20933:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1e98a7bcc0 - data ffff8a1e82287a20/ffff8a1eb1cd9000 00000020:01000000:0.0:1788658673.464529:0:20933:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1ebdadc600 - data ffff8a1e98fea1b0/ffff8a1e86c25400 00000001:00000004:1.0:1788658673.478942:0:20933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1788658673.569358:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658673.569369:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788658673.569378:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788658673.577559:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788658673.577572:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788658673.577608:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658673.577633:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788658673.582778:0:17902:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788658673.582804:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788658673.582821:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788658673.583446:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788658673.583452:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788658673.583476:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658673.583479:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788658673.583842:0:17904:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788658673.583847:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788658673.583866:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788658673.584645:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6faf9 00000020:00000080:0.0:1788658673.584656:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1e84e49800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788658673.585397:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fb0e 00000020:00000080:0.0:1788658673.585406:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1e9033a800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788658673.585412:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788658673.585417:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658673.585425:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788658673.585429:0:20933:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8a1ebd8819c0) has no exports 00000004:01000000:0.0:1788658673.585593:0:20933:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788658673.585603:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fb62 00000020:00000080:0.0:1788658673.585608:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1ec1292000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788658673.585612:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788658673.585616:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658673.585621:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788658673.585623:0:20933:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8a1ebf43cd40) has no exports 00000020:00000080:0.0:1788658673.585630:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fb5b 00000020:00000080:0.0:1788658673.585633:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1e88e59800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788658673.586873:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e84e49800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788658673.586890:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e9033a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1788658673.586895:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1292000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788658673.586902:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e88e59800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788658673.587341:0:20933:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788658673.587347:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788658673.587352:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788658673.587360:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658673.587363:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788658673.587423:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658673.587431:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788658673.587439:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fb4d 00000020:00000080:0.0:1788658673.587448:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1eb744c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788658673.587453:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788658673.587460:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658673.587477:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788658673.587482:0:20933:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8a1ebf4399c0) has no exports 00000020:00000080:0.0:1788658673.587490:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fb3f 00000020:00000080:0.0:1788658673.587494:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1eb7448000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788658673.587873:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ec1295800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788658673.587881:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1eb744f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788658673.587884:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb744f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788658673.587890:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788658673.587980:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb744c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788658673.587986:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb7448000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788658673.589189:0:20933:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788658673.589196:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788658673.589199:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788658673.589207:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658673.589209:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788658673.589315:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658673.589325:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788658673.589341:0:20933:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788658673.589348:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fb31 00000020:00000080:0.0:1788658673.589357:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1eb744a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788658673.591441:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb744b000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788658673.591464:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1eb744e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788658673.591468:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb744e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788658673.591480:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788658673.594462:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788658673.594478:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658673.594489:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788658673.594495:0:20933:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8a1eb3970000) has no exports 00000020:00000080:0.0:1788658673.594506:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fb2a 00000020:00000080:0.0:1788658673.594516:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1d83707800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788658673.596513:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb744a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788658673.601692:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d83707800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788658673.602866:0:20933:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788658673.602874:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788658673.602879:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788658673.602890:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788658673.602992:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658673.603007:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788658673.603041:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658673.603058:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788658673.603065:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1e88e5b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788658673.603069:0:20933:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e88e5b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788658673.603078:0:20933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788658673.603274:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fb15 00000020:00000080:1.0:1788658673.603283:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1e9033b800/lustre-MDD0001_UUID 00000020:01000000:1.0:1788658673.603288:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788658673.603305:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658673.603311:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788658673.603314:0:20933:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a1ebd883380) has no exports 00000020:00000080:1.0:1788658673.603332:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658673.603335:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788658673.603340:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fb1c 00000020:00000080:1.0:1788658673.603343:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1e9033d800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788658673.603352:0:20933:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1e82c42000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788658673.603355:0:20933:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1e82c42000 2 00000020:01000004:1.0:1788658673.603359:0:20933:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1e82c42000 from lustre-MDT0001 00000020:00000080:1.0:1788658673.603377:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658673.603380:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788658673.603383:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1e84e4a800/lustre-MDT0001_UUID 00000020:00000080:1.0:1788658673.603386:0:20933:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e84e4a800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788658673.603392:0:20933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788658673.603433:0:20933:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788658673.603437:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788658673.603439:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658673.603443:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788658673.603451:0:20933:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8a1d8345f800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788658673.603457:0:20933:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8a1ebf438000) has exports, disconnecting them 00000020:00080000:1.0:1788658673.603462:0:20933:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8a1d8345f800), last request at 1788658591 00000020:00000080:1.0:1788658673.603466:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fb9a 00000020:00080000:1.0:1788658673.603483:0:20933:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d8345f800): rc 0 00000020:00000080:1.0:1788658673.603493:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1d8345f800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788658673.604306:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d83706800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788658673.604318:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1ebdea2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788658673.604321:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdea2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788658673.604331:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788658673.604450:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e9033b800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788658673.604454:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1e9033b000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788658673.604456:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e9033b000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788658673.604461:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788658673.604579:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e9033d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788658673.604586:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d8345f800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788658673.685796:0:20933:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788658673.685806:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788658673.685812:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788658673.685819:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788658673.685858:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1e88e5f800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788658673.686085:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658673.686098:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788658673.686105:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1ec1297000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788658673.686109:0:20933:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1297000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788658673.686122:0:20933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788658673.686211:0:20933:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1e82c42000 1 00000020:00000080:3.0:1788658673.686218:0:20933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fac1 00000020:00000080:3.0:1788658673.686225:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1d83664000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788658673.686234:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788658673.686242:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d83664000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788658673.686252:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658673.686257:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788658673.686261:0:20933:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8a1eb23f4d40) has no exports 00010000:00010000:0.0:1788658673.734396:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788658673.872555:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658673.872569:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788658673.872583:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1e82c47800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788658673.872587:0:20933:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e82c47800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788658673.872600:0:20933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788658673.872754:0:20933:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a1e82c41800 00000020:01000000:2.0:1788658673.872783:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788658673.872787:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658673.872794:0:20933:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788658673.872799:0:20933:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8a1eb23f19c0) has no exports 00000100:00100000:2.0:1788658673.872893:0:17164:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8a1eae217000:17164] 2 exiting: rc = 0 00000100:00100000:2.0:1788658673.872994:0:17162:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8a1ea0fba000:17162] 0 exiting: rc = 1 00000100:00100000:1.0:1788658673.873185:0:17163:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8a1e885a7200:17163] 1 exiting: rc = 0 00000100:00100000:0.0:1788658673.873364:0:20300:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8a1d81b70000:20300] 4 exiting: rc = 0 00000100:00100000:0.0:1788658673.873418:0:18693:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8a1e9930a600:18693] 3 exiting: rc = 0 00000100:00100000:2.0:1788658673.873562:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873567:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873571:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873575:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873579:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873582:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873586:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873592:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873597:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873602:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873608:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873613:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873619:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873624:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873629:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873690:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873696:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873774:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873783:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873789:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873795:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873800:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873806:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873811:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873824:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873828:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873831:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873837:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873841:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873845:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873849:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873853:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873856:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873860:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873863:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873867:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873870:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873873:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873877:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873880:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873884:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873887:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873890:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873894:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873897:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873899:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873904:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873909:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873914:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873919:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873924:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873930:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873935:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873941:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873947:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873952:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873958:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873962:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873966:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873975:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873978:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873982:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873985:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.873989:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.877414:0:17166:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a1ea1807a00:17166] 1 exiting: rc = 0 00000100:00100000:1.0:1788658673.877605:0:17165:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a1ea1807400:17165] 0 exiting: rc = 1 00000100:00100000:3.0:1788658673.878033:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878042:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878049:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878055:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878061:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878066:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878071:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878077:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878083:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878088:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878094:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878099:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878104:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878110:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878115:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878121:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878127:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878133:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878139:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878144:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878149:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878154:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878160:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878165:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878170:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878175:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878194:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878199:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878204:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878209:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878213:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878218:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878223:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878227:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878231:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878236:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878241:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878245:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878250:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878255:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878259:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878264:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878269:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878274:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878278:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878283:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878287:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878291:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878296:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878301:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878306:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878311:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878326:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878332:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878337:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878343:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878348:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878353:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878359:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878364:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878369:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878384:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878388:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.878394:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658673.879216:0:18107:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8a1e86c47c00:18107] 2 exiting: rc = 0 00000100:00100000:2.0:1788658673.879353:0:17167:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8a1e8f2a1a00:17167] 0 exiting: rc = 1 00000100:00100000:3.0:1788658673.879443:0:17168:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8a1e8f2a0c00:17168] 1 exiting: rc = 0 00000100:00100000:3.0:1788658673.879510:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879517:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879524:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879531:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879538:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879544:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879550:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879557:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879564:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879572:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879578:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879585:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879607:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879615:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879622:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.879629:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880150:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880161:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880167:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880174:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880180:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880188:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880194:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880200:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880224:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880232:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880239:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880246:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880252:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880257:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880263:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880280:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880286:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880294:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880300:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880308:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880342:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880349:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880356:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880362:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880369:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880374:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880380:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880386:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880392:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880398:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880404:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880411:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880433:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880439:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880445:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880454:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880461:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880467:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880473:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880479:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880487:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880493:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880501:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880507:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880530:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880537:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880544:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.880550:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.890000:0:17169:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a1e83ea1e00:17169] 0 exiting: rc = 1 00000100:00100000:0.0:1788658673.890354:0:17170:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a1e83ea0400:17170] 1 exiting: rc = 0 00000100:00100000:2.0:1788658673.890481:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890490:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890496:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890501:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890507:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890512:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890518:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890523:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890529:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890535:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890541:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890548:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890554:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890560:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890565:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890571:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890578:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890584:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890589:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890595:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890600:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890606:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890612:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890618:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890624:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890630:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.890635:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891159:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891178:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891184:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891189:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891194:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891199:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891204:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891209:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891214:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891219:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891224:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891230:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891236:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891242:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891248:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891254:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891260:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891266:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891271:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891277:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891284:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891289:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891294:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891299:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891305:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891310:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891315:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891334:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891340:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891344:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891350:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891355:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891361:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891366:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891371:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891376:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658673.891390:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892010:0:17171:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a1e83ea0a00:17171] 0 exiting: rc = 1 00000100:00100000:1.0:1788658673.892165:0:17172:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a1ec1282c00:17172] 1 exiting: rc = 0 00000100:00100000:3.0:1788658673.892298:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892305:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892311:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892315:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892334:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892340:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892345:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892350:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892358:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892363:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892368:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892375:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892380:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892385:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892390:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892396:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892402:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892408:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892413:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892419:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892423:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892428:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892434:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892439:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892444:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892450:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892455:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892462:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892467:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892473:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892478:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892484:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892488:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892493:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892498:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892513:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892518:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892525:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892531:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892536:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892542:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892547:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892552:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892557:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892562:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892567:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892572:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892577:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892582:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892587:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892591:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892596:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892601:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892606:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892611:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892617:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892621:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892626:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892633:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892652:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892657:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892662:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892667:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.892671:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658673.893193:0:17173:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a1d81b41c00:17173] 0 exiting: rc = 1 00000100:00100000:1.0:1788658673.893273:0:17174:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a1ec1283c00:17174] 1 exiting: rc = 0 00000100:00100000:3.0:1788658673.893375:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893382:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893387:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893392:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893398:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893403:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893422:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893427:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893434:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893441:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893446:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893452:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893457:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893463:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893469:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893474:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893479:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893484:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893490:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893496:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893501:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893506:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893512:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893517:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893522:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893527:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893533:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893538:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893543:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893548:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893553:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893558:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893563:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893569:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893574:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893579:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893584:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893588:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893594:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893600:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893606:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893619:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893625:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893630:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893954:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893963:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893968:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893973:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893978:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893984:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893989:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.893995:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894000:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894005:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894010:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894016:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894022:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894028:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894032:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894037:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894043:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894048:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894053:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894059:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.894600:0:17177:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8a1e83ea0800:17177] 2 exiting: rc = 0 00000100:00100000:0.0:1788658673.894986:0:17176:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8a1ec1283e00:17176] 1 exiting: rc = 0 00000100:00100000:2.0:1788658673.895307:0:17175:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8a1ec1282000:17175] 0 exiting: rc = 1 00000100:00100000:3.0:1788658673.895399:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895407:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895413:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895438:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895445:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895451:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895457:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895462:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895468:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895475:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895482:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895504:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895510:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895516:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895522:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895527:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895534:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895540:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895547:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895552:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895558:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895564:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895570:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895575:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895581:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895587:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895594:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895615:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895622:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895628:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895634:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895654:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895660:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895665:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895671:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895678:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895684:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895689:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895699:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895729:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895735:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895741:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895748:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895755:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895762:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895768:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895782:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895790:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895795:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895803:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895811:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895832:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895839:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895845:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895852:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895860:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895865:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895873:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895879:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895885:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895891:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895897:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895904:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658673.895919:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788658673.902354:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658673.902370:0:20933:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788658673.902377:0:20933:0:(genops.c:885:class_export_put()) final put ffff8a1d83d58000/MDS_uuid 00000020:00000080:3.0:1788658673.902382:0:20933:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d83d58000/MDS_uuid for MDS 00000020:01000000:3.0:1788658673.902395:0:20933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788658673.902591:0:20933:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788658674.759558:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658675.775732:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788658676.672381:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788658676.672391:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658676.672395:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788658676.672399:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788658676.672404:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658676.672412:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 588 00000100:00080000:2.0:1788658676.672419:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788658676.672427:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a1d832d5000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658676.672470:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83798700 x1875544025304832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658676.672510:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788658676.672513:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788658676.672515:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1e92f80800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658676.672519:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 588 00000100:00080000:2.0:1788658676.672522:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788658676.672526:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a1e92f80800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658676.672537:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83798a80 x1875544025305088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658676.672693:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025304960:0@lo:400:kworker.0 00000400:00000100:3.0:1788658676.672781:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025304960 offset 0 length 224: 4 00000100:00100000:2.0:1788658676.673033:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025305216:0@lo:400:kworker.0 00000400:00000100:2.0:1788658676.673063:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025305216 offset 0 length 224: 4 00000100:00100000:2.0:1788658676.673129:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025304832:0@lo:38:kworker.0 00000400:00000100:2.0:1788658676.673171:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025304832 offset 0 length 520: 4 00000100:00100000:2.0:1788658676.673185:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025305088:0@lo:38:kworker.0 00000400:00000100:2.0:1788658676.673201:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025305088 offset 0 length 520: 4 00010000:00010000:0.0:1788658676.803349:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658677.826955:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788658678.168679:0:21136:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788658678.175163:0:21136:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788658678.175249:0:21136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658678.175293:0:21136:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658678.175301:0:21136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658678.175309:0:21136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658678.175342:0:21136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788658678.175349:0:21136:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788658678.175368:0:20934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658678.175377:0:20934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658678.175395:0:20934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658678.175400:0:20934:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788658678.175404:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1788658678.175410:0:20934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658678.175417:0:20934:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658678.175420:0:21136:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d83798700 x1875544025304832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658691 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788658678.175425:0:20934:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788658678.175428:0:20934:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788658678.175430:0:20934:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1788658678.175442:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1788658678.175449:0:20934:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1d83d58800 00000100:00080000:0.0:1788658678.175450:0:21136:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1788658678.175452:0:20934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788658678.175458:0:21136:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1788658678.175460:0:20934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788658678.175465:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658678.175469:0:21136:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d83798700 x1875544025304832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658691 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658678.175477:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788658678.175481:0:21136:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1788658678.175493:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658678.175495:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658678.175497:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658678.175605:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025304832:0@lo:38:kworker.0 00000100:00080000:0.0:1788658678.176957:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788658678.176973:0:21136:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d8379a680 x1875544025304960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658692 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658678.176999:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788658678.177008:0:21136:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788658678.177066:0:21136:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d3000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788658678.177130:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875544025305344:0@lo:39:umount.0 00000400:00000100:2.0:1788658678.177222:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025305344 offset 0 length 224: 4 00000100:00100000:1.0:1788658678.177440:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025304960:0@lo:400:kworker.0 00000100:00080000:2.0:1788658678.720164:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788658678.720176:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658678.720180:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788658678.720184:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788658678.720446:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658678.720477:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025305472:0@lo:400:kworker.0 00000400:00000100:2.0:1788658678.720553:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025305472 offset 0 length 224: 4 00000001:00100000:1.0:1788658678.726139:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788658678.726152:0:18664:0:(genops.c:885:class_export_put()) final put ffff8a1d8266d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788658678.726466:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d8266d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788658678.726550:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d8266b800 for lustre-OST0000 00000001:00100000:3.0:1788658678.727204:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788658678.727212:0:19484:0:(genops.c:885:class_export_put()) final put ffff8a1d831d6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788658678.727288:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d831d6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788658678.727340:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb4838000 for lustre-OST0001 00010000:00010000:0.0:1788658678.847161:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658679.871034:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658680.895819:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658681.727907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788658681.727923:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658681.727927:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788658681.727931:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788658681.728071:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658681.728100:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025305600:0@lo:400:kworker.0 00000400:00000100:2.0:1788658681.728177:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025305600 offset 0 length 224: 4 00010000:00010000:0.0:1788658681.918897:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658682.943324:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658683.327207:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658673/real 1788658673] req@ffff8a1d81b3b480 x1875544025304704/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788658683 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658683.327244:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d81b3b480 x1875544025304704/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788658683 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788658683.327268:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d83d58800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788658683.327292:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788658683.327296:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:913293d7-fe00-4834-a4c1-1b0cae17d59a:3646:1875544025304704:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1788658683.328069:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788658683.328106:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788658683.328109:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1d83d58800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658683.328116:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 590 00000100:00080000:2.0:1788658683.328122:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.153@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788658683.328129:0:37:0:(import.c:665:import_select_connection()) MGC192.168.202.153@tcp: import ffff8a1d83d58800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658683.328163:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d8379b800 x1875544025305728/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658683.328203:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788658683.328208:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788658683.328304:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025305856:0@lo:400:kworker.0 00000400:00000100:3.0:1788658683.328361:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025305856 offset 0 length 224: 4 00000100:00100000:1.0:1788658683.328564:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:913293d7-fe00-4834-a4c1-1b0cae17d59a:3646:1875544025305728:0@lo:250:kworker.0 00000400:00000100:1.0:1788658683.328591:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875544025305728 offset 0 length 520: 4 00010000:00010000:1.0:1788658683.966861:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658684.991812:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658686.015061:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658687.039046:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658688.063125:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658688.448853:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658678/real 1788658678] req@ffff8a1eb1c97800 x1875544025305344/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658688 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658688.448894:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1eb1c97800 x1875544025305344/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658688 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788658688.448916:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d3000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788658688.448948:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875544025305344:0@lo:39:umount.0 00000100:00080000:3.0:1788658688.449072:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788658688.449076:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788658688.449106:0:21136:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788658688.450085:0:21136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658688.450105:0:21136:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658688.450113:0:21136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658688.450120:0:21136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658688.450222:0:21136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658688.450231:0:21136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658688.450239:0:21136:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658688.450244:0:21136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658688.450251:0:21136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788658688.451285:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788658688.451293:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658688.451296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788658688.451299:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788658688.451395:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658688.451415:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025305984:0@lo:400:kworker.0 00000400:00000100:2.0:1788658688.451476:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025305984 offset 0 length 224: 4 00010000:00010000:3.0:1788658688.455894:0:21136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788658688.455914:0:21136:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788658688.455964:0:21136:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788658688.455968:0:21136:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788658688.455980:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658688.456003:0:21136:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788658688.456009:0:21136:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a1d821b8000) has no exports 00000020:00080000:3.0:1788658688.456037:0:21136:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a1d821b8000) has no exports 00010000:00010000:1.0:1788658688.457818:0:20934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658688.457834:0:20934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658688.457847:0:20934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658688.457852:0:20934:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658688.457863:0:20934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658688.457897:0:20934:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658688.457904:0:20934:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788658688.457907:0:20934:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788658688.457911:0:20934:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788658688.457930:0:20934:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1d83d58800 00010000:00010000:1.0:1788658688.457935:0:20934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658688.457941:0:20934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658688.457960:0:20934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658688.457964:0:20934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658688.457969:0:20934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418e00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658688.457972:0:20934:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658688.457978:0:20934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658688.457984:0:20934:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658688.457989:0:20934:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788658688.457991:0:20934:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788658688.458000:0:20934:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788658688.458007:0:20934:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1d83d58800 00010000:00010000:1.0:1788658688.458010:0:20934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658688.458015:0:20934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658688.458024:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658688.458025:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658688.458027:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658688.458104:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788658688.460926:0:21136:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1e98a7b300 - data ffff8a1e9ee7aa20/ffff8a1eb1cdb000 00000020:01000000:3.0:1788658688.461100:0:21136:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1d836f12a0 - data ffff8a1e9ed61438/ffff8a1d83e01800 00100000:10000000:3.0:1788658688.478973:0:21136:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788658688.487485:0:21136:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fc1f 00000020:00000080:1.0:1788658688.487503:0:21136:0:(genops.c:885:class_export_put()) final put ffff8a1d831d0800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788658688.487535:0:21136:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1e88e5d000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788658688.487540:0:21136:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1e88e5d000 2 00000020:01000004:1.0:1788658688.487542:0:21136:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1e88e5d000 from lustre-OST0000 00000020:00000080:2.0:1788658688.487623:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d831d0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788658688.487890:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658688.487902:0:21136:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788658688.487906:0:21136:0:(genops.c:885:class_export_put()) final put ffff8a1d831d1800/lustre-OST0000_UUID 00000020:00000080:1.0:1788658688.487908:0:21136:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d831d1800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788658688.487915:0:21136:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788658688.487981:0:21136:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788658688.487986:0:21136:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788658688.487990:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658688.487996:0:21136:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788658688.488003:0:21136:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a1d832d2800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788658688.488010:0:21136:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8a1e8f254d40) has exports, disconnecting them 00000020:00080000:1.0:1788658688.488015:0:21136:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a1d832d2800), last request at 1788658609 00000020:00000080:1.0:1788658688.488020:0:21136:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fc49 00000020:00080000:1.0:1788658688.488030:0:21136:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d832d2800): rc 0 00000020:00000080:1.0:1788658688.488036:0:21136:0:(genops.c:885:class_export_put()) final put ffff8a1d832d2800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788658688.488134:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d832d2800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788658688.493171:0:21136:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788658688.493181:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658688.493185:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788658688.493194:0:21136:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788658688.493430:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658688.493440:0:21136:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788658688.493446:0:21136:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788658688.493451:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658688.493455:0:21136:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788658688.493463:0:21136:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8a1d832d0000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658688.493470:0:21136:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8a1e8f250000) has exports, disconnecting them 00000020:00080000:0.0:1788658688.493474:0:21136:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8a1d832d0000), last request at 1788658609 00000020:00000080:0.0:1788658688.493478:0:21136:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fc5e 00000020:00080000:0.0:1788658688.493496:0:21136:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d832d0000): rc 0 00000020:00000080:0.0:1788658688.493502:0:21136:0:(genops.c:885:class_export_put()) final put ffff8a1d832d0000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788658688.493768:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d832d5000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788658688.493777:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1ec1293800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788658688.493780:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1293800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788658688.493788:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788658688.493860:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d832d0000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788658688.502769:0:21136:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788658688.502781:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788658688.502785:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788658688.502793:0:21136:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788658688.503007:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658688.503018:0:21136:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788658688.503027:0:21136:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1e88e5d000 1 00000020:00000080:0.0:1788658688.503034:0:21136:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fbfc 00000020:00000080:0.0:1788658688.503044:0:21136:0:(genops.c:885:class_export_put()) final put ffff8a1ec1294800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788658688.503050:0:21136:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788658688.503058:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658688.503063:0:21136:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788658688.503067:0:21136:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8a1eb4868000) has no exports 00000020:00000080:2.0:1788658688.511988:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d832d3000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788658688.512017:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1d832d1800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788658688.512022:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d832d1800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788658688.512032:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788658688.512284:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1294800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788658688.625322:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658688.625338:0:21136:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788658688.625345:0:21136:0:(genops.c:885:class_export_put()) final put ffff8a1d8345e000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788658688.625350:0:21136:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d8345e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788658688.625362:0:21136:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788658688.625499:0:21136:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a1e88e5c800 00000020:02000400:0.0:1788658688.625567:0:21136:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788658689.092346:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658690.110978:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658691.135550:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658691.522971:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658676/real 1788658676] req@ffff8a1d83798a80 x1875544025305088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788658691 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658691.522999:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d83798a80 x1875544025305088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788658691 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788658691.523016:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e92f80800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788658691.523035:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788658691.523038:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025305088:0@lo:38:kworker.0 00000100:00080000:2.0:1788658691.523685:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788658691.523697:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658691.523700:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788658691.523718:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788658691.523723:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1e92f80800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658691.523733:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 593 00000100:00080000:2.0:1788658691.523741:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788658691.523750:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a1e92f80800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658691.523799:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83798e00 x1875544025306112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658691.523888:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025306112:0@lo:38:kworker.0 00000100:00100000:2.0:1788658691.523936:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025306240:0@lo:400:kworker.0 00000400:00000100:1.0:1788658691.523948:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025306112 offset 0 length 520: 4 00000400:00000100:2.0:1788658691.523994:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025306240 offset 0 length 224: 4 00000100:00000400:2.0:1788658692.014788:0:3649:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658676/real 1788658676] req@ffff8a1d8379b480 x1875544025305216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658692 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658692.052251:0:3649:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8a1d8379b480 x1875544025305216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658692 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658692.052270:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8a1d83704000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788658692.052275:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788658692.070084:0:3649:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1788658692.070272:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025305216:0@lo:400:kworker.0 00000100:00080000:1.0:1788658692.070560:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788658692.070567:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658692.070570:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788658692.070574:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658692.070576:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788658692.070579:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788658692.070584:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1d83704000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658692.070591:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 542 00000100:00080000:1.0:1788658692.070601:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a1d83704000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658692.070639:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb98e00 x1875544025306368/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658692.080481:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875544025306368:0@lo:38:kworker.0 00000400:00000100:2.0:1788658692.080545:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025306368 offset 0 length 520: 4 00010000:00010000:3.0:1788658692.159292:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788658692.821627:0:21338:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788658692.836307:0:21338:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788658692.837199:0:21338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.837219:0:21338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.837227:0:21338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.837235:0:21338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.837312:0:21338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788658692.837320:0:21338:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788658692.837378:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788658692.837395:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d83798e00 x1875544025306112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658711 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658692.837428:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788658692.837437:0:21338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788658692.837446:0:21338:0:(import.c:65:import_set_state_nolock()) ffff8a1e92f80800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788658692.837471:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788658692.837477:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d83798e00 x1875544025306112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658711 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658692.837485:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788658692.837488:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1788658692.841350:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025306112:0@lo:38:kworker.0 00010000:00010000:0.0:1788658692.843657:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658692.843683:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658692.843698:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658692.843793:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658692.843928:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658692.843937:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658692.843944:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658692.843947:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788658692.844021:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788658692.844066:0:17151:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1d83d58800 00010000:00010000:0.0:1788658692.844072:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658692.844111:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788658692.844541:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788658692.844563:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d83798700 x1875544025305472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658694 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658692.845167:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1ebdb99c00 x1875544025305600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658697 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658692.845190:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d8379ad80 x1875544025305856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658699 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658692.845199:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d83798000 x1875544025305984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658704 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658692.845215:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d8379a300 x1875544025306240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658707 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658692.845224:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1ebdb98e00 x1875544025306368/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658702 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788658692.845270:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658692.845273:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658692.845276:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658692.845354:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025305856:0@lo:400:kworker.0 00000100:00100000:3.0:1788658692.845520:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788658692.845531:0:21338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788658692.845598:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025305472:0@lo:400:kworker.0 00000100:00100000:0.0:1788658692.845630:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025305600:0@lo:400:kworker.0 00000100:00080000:3.0:1788658692.845922:0:21338:0:(import.c:65:import_set_state_nolock()) ffff8a1d83704000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788658692.845932:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788658692.845940:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d83798700 x1875544025305472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658694 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658692.845962:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d83798000 x1875544025305984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658704 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658692.845970:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d8379a300 x1875544025306240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658707 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658692.845998:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1ebdb98e00 x1875544025306368/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658702 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658692.846003:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788658692.846007:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788658692.846184:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875544025306368:0@lo:38:kworker.0 00000100:00100000:2.0:1788658692.846377:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025306240:0@lo:400:kworker.0 00000100:00100000:2.0:1788658692.846622:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025305984:0@lo:400:kworker.0 00010000:00010000:3.0:1788658692.848770:0:21338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.848795:0:21338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.848921:0:21338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.848931:0:21338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.849191:0:21338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658692.849204:0:21338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.849213:0:21338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.849220:0:21338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.849228:0:21338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658692.849535:0:20934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658692.849546:0:20934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658692.849555:0:20934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045c00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658692.849568:0:20934:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658692.849577:0:20934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658692.849585:0:20934:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658692.849591:0:20934:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788658692.849594:0:20934:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788658692.849611:0:20934:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1d83d58800 00010000:00010000:1.0:1788658692.849616:0:20934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658692.849623:0:20934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658692.849642:0:20934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658692.849646:0:20934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658692.849653:0:20934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419000 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658692.849656:0:20934:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658692.849663:0:20934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658692.849669:0:20934:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658692.849686:0:20934:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788658692.849688:0:20934:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788658692.849694:0:20934:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1d83d58800 00010000:00010000:1.0:1788658692.849697:0:20934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658692.850211:0:21338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:3.0:1788658692.850221:0:21338:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788658692.850227:0:21338:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788658692.850229:0:21338:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788658692.850277:0:21338:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788658692.850284:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788658692.850292:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658692.850300:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788658692.850306:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8a1eb3973380) has no exports 00000020:00080000:3.0:1788658692.850354:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8a1eb3973380) has no exports 00010000:00010000:1.0:1788658692.850584:0:20934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658692.850609:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658692.850611:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658692.853917:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788658692.854149:0:21338:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1d83350540 - data ffff8a1e9ec716c0/ffff8a1eb395f800 00000020:01000000:3.0:1788658692.854545:0:21338:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1d83350ae0 - data ffff8a1e9ec6e438/ffff8a1d81b55800 00010000:00010000:1.0:1788658692.855148:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788658692.866989:0:21338:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788658692.885160:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fd84 00000020:00000080:2.0:1788658692.885174:0:21338:0:(genops.c:885:class_export_put()) final put ffff8a1d821b2800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788658692.885206:0:21338:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1eb4839000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788658692.885211:0:21338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1eb4839000 2 00000020:01000004:2.0:1788658692.885215:0:21338:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1eb4839000 from lustre-OST0001 00000020:00000080:0.0:1788658692.885241:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d821b2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788658692.885251:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658692.885266:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788658692.885271:0:21338:0:(genops.c:885:class_export_put()) final put ffff8a1d821b6800/lustre-OST0001_UUID 00000020:00000080:2.0:1788658692.885275:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d821b6800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788658692.885285:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788658692.886575:0:21338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS 00010000:00010000:2.0:1788658692.886597:0:21338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6fac8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6facf expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658692.886617:0:21338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6fac8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6facf expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658692.886625:0:21338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788658692.886628:0:21338:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788658692.886631:0:21338:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788658692.888248:0:21338:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1d83d58800 00010000:00010000:2.0:1788658692.888283:0:21338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6fac8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6facf expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658692.888329:0:21338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658692.888359:0:21338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658692.888366:0:21338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788658692.888369:0:21338:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788658692.888372:0:21338:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788658692.888397:0:21338:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1d83d58800 00010000:00010000:2.0:1788658692.888401:0:21338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788658692.888427:0:21338:0:(import.c:65:import_set_state_nolock()) ffff8a1d83d58800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788658692.888433:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788658692.888436:0:21338:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788658692.888438:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788658692.888443:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788658692.888457:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d8379b800 x1875544025305728/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788658698 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788658692.888486:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788658692.888489:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1788658692.888556:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:913293d7-fe00-4834-a4c1-1b0cae17d59a:3646:1875544025305728:0@lo:250:kworker.0 10000000:01000000:2.0:1788658692.889000:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788658692.889013:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6f9a2 00000020:00000080:2.0:1788658692.889024:0:21338:0:(genops.c:885:class_export_put()) final put ffff8a1d83d5a000/913293d7-fe00-4834-a4c1-1b0cae17d59a 00000020:01000000:2.0:1788658692.889047:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.153@tcp (flags='') 00000020:00000080:2.0:1788658692.889067:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658692.889075:0:21338:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.153@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788658692.889080:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8a1eb23f0000) has no exports 10000000:01000000:1.0:1788658692.889525:0:17159:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1788658692.889930:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d83d5a000/913293d7-fe00-4834-a4c1-1b0cae17d59a for MGC192.168.202.153@tcp 10000000:01000000:2.0:1788658692.889947:0:21338:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.153@tcp: client import never connected 00000100:00080000:2.0:1788658692.889955:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788658692.889958:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788658692.889962:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788658692.889965:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788658692.894616:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d83d58800 for MGC192.168.202.153@tcp 00000020:00000080:0.0:1788658692.894751:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658692.894765:0:21338:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.153@tcp (uuid 913293d7-fe00-4834-a4c1-1b0cae17d59a) 00000020:00000080:0.0:1788658692.894772:0:21338:0:(genops.c:885:class_export_put()) final put ffff8a1d83d5b000/913293d7-fe00-4834-a4c1-1b0cae17d59a 00000020:00000080:0.0:1788658692.894776:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d83d5b000/913293d7-fe00-4834-a4c1-1b0cae17d59a for MGC192.168.202.153@tcp 00000020:01000000:0.0:1788658692.894787:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.153@tcp (913293d7-fe00-4834-a4c1-1b0cae17d59a) 00000020:01000000:0.0:1788658692.895207:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788658692.895215:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658692.895224:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788658692.895233:0:21338:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a1ebdea0800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658692.895240:0:21338:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8a1eb39719c0) has exports, disconnecting them 00000020:00080000:0.0:1788658692.895246:0:21338:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a1ebdea0800), last request at 1788658625 00000020:00000080:0.0:1788658692.895251:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fdae 00000020:00080000:0.0:1788658692.895275:0:21338:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1ebdea0800): rc 0 00000020:00000080:0.0:1788658692.895283:0:21338:0:(genops.c:885:class_export_put()) final put ffff8a1ebdea0800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788658692.897784:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdea0800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788658692.897919:0:21338:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788658692.897929:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788658692.897935:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788658692.897945:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788658692.898215:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658692.898230:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788658692.898241:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788658692.898248:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658692.898254:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788658692.898265:0:21338:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8a1d831d1000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788658692.898272:0:21338:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8a1e844519c0) has exports, disconnecting them 00000020:00080000:1.0:1788658692.898277:0:21338:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8a1d831d1000), last request at 1788658625 00000020:00000080:1.0:1788658692.898283:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fdc3 00000020:00080000:1.0:1788658692.898321:0:21338:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d831d1000): rc 0 00000020:00000080:1.0:1788658692.898328:0:21338:0:(genops.c:885:class_export_put()) final put ffff8a1d831d1000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788658692.899969:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1e92f80800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788658692.899989:0:8:0:(genops.c:885:class_export_put()) final put ffff8a1d821b7000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788658692.899992:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d821b7000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788658692.900005:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788658692.900107:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d831d1000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788658692.913882:0:21338:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788658692.913897:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788658692.913904:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788658692.913915:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788658692.913969:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d83704000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788658692.919667:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788658692.920241:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788658692.920536:0:20934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788658692.921042:0:17145:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a1d83723c00:17145] 0 exiting: rc = 1 00000100:00100000:3.0:1788658692.921183:0:17146:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a1d83722800:17146] 1 exiting: rc = 0 00000100:00100000:2.0:1788658692.921312:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658692.925693:0:17148:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a1d83723000:17148] 1 exiting: rc = 0 00000100:00100000:2.0:1788658692.926082:0:17149:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a1d83722e00:17149] 2 exiting: rc = 0 00000100:00100000:0.0:1788658692.926202:0:18316:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a1e812ea400:18316] 3 exiting: rc = 0 00000100:00100000:1.0:1788658692.926590:0:17147:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a1d83723400:17147] 0 exiting: rc = 1 00000100:00100000:2.0:1788658692.926737:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926748:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926755:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926763:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926770:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926778:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926786:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926791:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926861:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926868:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926875:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926881:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926887:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926905:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926912:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926919:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926926:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926931:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926937:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.926943:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927022:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927029:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927035:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927041:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927058:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927067:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927075:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927082:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927088:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927094:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927102:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927108:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927118:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927125:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927131:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927137:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927143:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927149:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927155:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927161:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927168:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927175:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927182:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927190:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927196:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927202:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927208:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927214:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927229:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927235:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927241:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927248:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927255:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927261:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927267:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927273:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927280:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927287:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927294:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927302:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927307:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927314:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927321:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.927327:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788658692.929035:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658692.929060:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788658692.929067:0:21338:0:(genops.c:885:class_export_put()) final put ffff8a1eb483d800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788658692.929073:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb483d800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788658692.929079:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788658692.929154:0:21338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1eb4839000 1 00000020:00000080:2.0:1788658692.929163:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6fd68 00000020:00000080:2.0:1788658692.929173:0:21338:0:(genops.c:885:class_export_put()) final put ffff8a1d832d5800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788658692.929236:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788658692.929242:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658692.929248:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788658692.929254:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8a1e84453380) has no exports 00000020:00000080:0.0:1788658692.933937:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d832d5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788658692.974880:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658692.974901:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788658692.974909:0:21338:0:(genops.c:885:class_export_put()) final put ffff8a1eb4839800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788658692.974915:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb4839800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788658692.974930:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788658692.976173:0:21338:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a1eb483c800 00000020:01000000:2.0:1788658692.976210:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788658692.976218:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658692.976227:0:21338:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788658692.976232:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8a1eb486b380) has no exports 00000020:00000080:2.0:1788658692.976259:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658692.976270:0:21338:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788658692.976275:0:21338:0:(genops.c:885:class_export_put()) final put ffff8a1ec1291800/OSS_uuid 00000020:00000080:2.0:1788658692.976279:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1291800/OSS_uuid for OSS 00000020:01000000:2.0:1788658692.976286:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788658692.976376:0:17158:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788658692.976675:0:18669:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8a1d82455000:18669] 1 exiting: rc = 0 00000100:00100000:0.0:1788658692.976786:0:18670:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8a1e8595b800:18670] 2 exiting: rc = 0 00000100:00100000:0.0:1788658692.976925:0:18667:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8a1d82454a00:18667] 0 exiting: rc = 1 00000100:00100000:0.0:1788658692.977114:0:19325:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8a1d844dce00:19325] 3 exiting: rc = 0 00000100:00100000:2.0:1788658692.977254:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977265:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977271:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977278:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977284:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977289:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977296:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977303:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977308:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977314:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977320:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977326:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977332:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977666:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977672:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977678:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977684:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977690:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977697:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977730:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977738:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977744:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977751:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977758:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.977764:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978166:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978178:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978186:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978192:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978199:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978205:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978211:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978218:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978224:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978231:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978237:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978243:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978249:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978255:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978262:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978268:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978274:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978281:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978288:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978294:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978300:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978306:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978313:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978320:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978327:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978333:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978692:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978699:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978740:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978745:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978751:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978757:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978763:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978769:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.978775:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.979182:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.979188:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.979194:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.979213:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.982032:0:18672:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a1d83722600:18672] 1 exiting: rc = 0 00000100:00100000:3.0:1788658692.984230:0:18671:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a1d83723800:18671] 0 exiting: rc = 1 00000100:00100000:0.0:1788658692.984554:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984576:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984582:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984587:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984594:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984599:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984605:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984610:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984616:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984621:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984626:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984632:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984637:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984662:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984681:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984688:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.984694:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986151:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986187:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986194:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986200:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986206:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986212:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986230:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986238:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986244:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986251:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986258:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986263:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986287:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986293:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986300:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986305:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986311:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986317:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986322:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986328:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986342:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986350:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986370:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986380:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986386:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986394:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986401:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986408:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986483:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986489:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986495:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986501:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986507:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986513:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986519:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986525:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986531:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986536:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986541:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986547:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986553:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986559:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986576:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986582:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986587:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986593:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658692.986603:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658692.989396:0:18674:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a1e86c0e000:18674] 1 exiting: rc = 0 00000100:00100000:0.0:1788658692.990290:0:20302:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8a1d830c8000:20302] 3 exiting: rc = 0 00000100:00100000:3.0:1788658692.990603:0:18675:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a1e8318e000:18675] 2 exiting: rc = 0 00000100:00100000:0.0:1788658692.990884:0:18673:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a1d8348e600:18673] 0 exiting: rc = 1 00000100:00100000:1.0:1788658692.991185:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991195:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991202:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991226:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991234:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991241:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991247:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991253:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991259:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991266:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991273:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991280:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991287:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991293:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991299:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991305:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991311:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991317:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991324:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991331:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991337:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991344:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991351:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991358:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991365:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991371:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991377:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991630:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991640:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991647:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991654:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991660:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991666:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991673:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991680:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991686:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991693:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991700:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991735:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991741:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991747:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991753:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991760:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991767:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991773:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991779:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991784:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991798:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991806:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991813:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991819:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991840:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991847:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991853:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991860:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991865:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991871:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991878:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991884:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991901:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991910:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991917:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991932:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658692.991957:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658693.003349:0:18676:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a1e86c0e400:18676] 0 exiting: rc = 1 00000100:00100000:0.0:1788658693.003668:0:18677:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a1e86c0fa00:18677] 1 exiting: rc = 0 00000100:00100000:1.0:1788658693.003815:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003824:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003830:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003836:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003842:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003847:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003852:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003857:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003863:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003868:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003874:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003880:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003887:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003893:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003899:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003904:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003910:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003915:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003920:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003926:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003932:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.003939:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004064:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004069:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004075:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004080:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004085:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004091:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004098:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004104:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004110:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004115:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004120:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004145:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004150:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004156:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004161:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004167:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004173:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004178:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004184:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004191:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004197:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004204:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004212:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004218:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004226:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004232:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004238:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004244:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004250:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004255:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004260:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004265:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004271:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004276:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004282:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004287:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004292:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004299:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004305:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004311:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004317:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.004323:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658693.006086:0:18678:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a1e86c05a00:18678] 0 exiting: rc = 1 00000100:00100000:3.0:1788658693.006228:0:18679:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a1e86c04800:18679] 1 exiting: rc = 0 00000100:00100000:1.0:1788658693.006498:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.006510:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.006518:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.006527:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.006555:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.006647:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.006655:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.006694:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007215:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007226:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007234:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007242:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007249:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007256:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007263:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007269:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007275:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007282:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007289:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007315:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007323:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007331:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007474:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007485:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007493:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007499:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007506:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007514:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007521:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007528:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007536:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007640:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007652:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007658:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007664:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007670:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007677:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007683:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007689:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007777:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007785:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007860:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007868:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007894:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007905:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007914:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007922:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007930:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.007937:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008123:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008133:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008142:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008150:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008158:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008166:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008189:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008197:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008206:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008212:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008220:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008228:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008235:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008244:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658693.008266:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788658693.028315:0:21338:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788658712.562104:0:22102:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788658722.881601:0:22701:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788658722.881607:0:22701:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788658722.881609:0:22701:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788658722.881740:0:22701:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1d810f6800 00000020:01000004:2.0:1788658722.881757:0:22701:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788658722.881764:0:22701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788658722.881779:0:22701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a1eb39719c0) 00000020:00000080:2.0:1788658722.881795:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788658722.937517:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788658722.940162:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788658722.947809:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788658722.948544:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788658722.948819:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788658722.949088:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788658722.949531:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788658722.949767:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788658722.950147:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788658722.950642:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788658722.950896:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788658722.951337:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788658722.951546:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788658722.951757:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788658722.953312:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788658722.953557:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788658722.956525:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788658722.956955:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788658722.957303:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788658722.957524:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788658722.958143:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788658722.958770:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788658722.961425:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788658722.962542:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788658722.963030:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788658722.963549:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788658722.964022:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788658722.966762:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788658722.967765:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788658722.968282:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788658722.968545:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788658722.969304:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788658722.970070:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788658722.970372:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788658722.970616:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788658722.971066:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788658722.971754:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788658722.972598:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788658722.977136:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788658722.978328:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788658722.979061:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788658722.979357:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788658722.980014:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788658722.980562:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788658722.981128:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788658722.981729:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788658722.982647:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788658722.991560:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788658722.992097:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788658722.993040:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788658722.994118:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788658722.998137:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788658723.000651:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1788658723.003797:0:22701:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788658723.004067:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788658723.004077:0:22701:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788658723.004091:0:22701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c701f9 00000020:01000004:2.0:1788658723.004099:0:22701:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788658723.004104:0:22701:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788658723.004110:0:22701:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1d810f6800 from MGS 00000020:01000004:2.0:1788658723.004113:0:22701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788658723.004124:0:22701:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a1eb3973380) 00000020:00000080:2.0:1788658723.004135:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788658723.004195:0:22701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d810f6800 from MGS, refs=2 00080000:01000000:2.0:1788658723.004199:0:22701:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658723.004204:0:22701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c70207 00000100:00100000:2.0:1788658723.006558:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788658723.006735:0:22701:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788658723.006743:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788658723.008256:0:22701:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788658723.008266:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788658723.008924:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658723.009105:0:22701:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788658723.009111:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788658723.010241:0:22701:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788658723.010252:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788658723.012568:0:22701:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788658723.012580:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788658723.013604:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658723.013608:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658723.013610:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658723.014017:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658723.014020:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658723.014022:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658723.014543:0:22701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788658723.018842:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788658723.024064:0:22701:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788658723.027054:0:22713:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788658723.027125:0:22701:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788658723.027182:0:22701:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788658723.029191:0:22701:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788658723.029507:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658723.029691:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788658723.029800:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788658723.030808:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788658723.030816:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788658723.040307:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788658723.040323:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788658723.041024:0:22718:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788658723.041110:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788658723.041130:0:22701:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.153@tcp' 00000020:01000004:2.0:1788658723.041132:0:22701:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788658723.041162:0:22701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.153@tcp (typ=mgc) 00000020:00000080:2.0:1788658723.041175:0:22701:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.153@tcp (ffff8a1eb3974d40) 00000020:00000080:2.0:1788658723.041192:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788658723.041271:0:22701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1ead204800@MGC192.168.202.153@tcp: add connection 192.168.202.153@tcp at head 00010000:00010000:2.0:1788658723.041425:0:22701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.153@tcp-0 is initialized 00000040:01000000:2.0:1788658723.041433:0:22701:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788658723.050598:0:22719:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788658723.050740:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.153@tcp (uuid ff20339a-cc79-4b28-8cfb-5b5d564cc9fb) 00000020:00000080:2.0:1788658723.050763:0:22701:0:(genops.c:1385:class_connect()) connect: client ff20339a-cc79-4b28-8cfb-5b5d564cc9fb, cookie 0x48e67cc629c70215 00000100:00080000:2.0:1788658723.050776:0:22701:0:(import.c:545:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658723.050783:0:22701:0:(import.c:665:import_select_connection()) MGC192.168.202.153@tcp: import ffff8a1ead204800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658723.050816:0:22701:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83798000 x1875544025306496/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658723.050840:0:22701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ff20339a-cc79-4b28-8cfb-5b5d564cc9fb->MGS 00000020:01000004:2.0:1788658723.050859:0:22701:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788658723.050864:0:22701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788658723.050879:0:22701:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a1eb3970000) 00000020:00000080:2.0:1788658723.050891:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788658723.057108:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3646:1875544025306496:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788658723.057187:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658723.057268:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025306496 00000100:00100000:1.0:1788658723.057275:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025306496 00000100:00100000:1.0:1788658723.057309:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658723.057316:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875544025306496:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788658723.057342:0:22714:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ff20339a-cc79-4b28-8cfb-5b5d564cc9fb@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:1.0:1788658723.057373:0:22714:0:(genops.c:1385:class_connect()) connect: client ff20339a-cc79-4b28-8cfb-5b5d564cc9fb, cookie 0x48e67cc629c70223 00000100:00080000:1.0:1788658723.057500:0:22714:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3b6f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658723.057551:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+5:3646:x1875544025306496:12345-0@lo:250:mount.lustre.0 Request processed in 233us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658723.057558:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658723.057622:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788658723.057631:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.153@tcp: connect to target with instance 0 00000100:00080000:1.0:1788658723.057637:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788658723.057653:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788658723.057665:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ead204800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788658723.057668:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788658723.057684:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788658723.057689:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3646:1875544025306496:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788658723.070621:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658723.074370:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788658723.074380:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788658723.080721:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788658723.080744:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788658723.081268:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788658723.081275:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788658723.086404:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658723.086603:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788658723.086609:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788658723.090169:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788658723.090186:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788658723.133300:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658723.133510:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788658723.133517:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788658723.134518:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788658723.134529:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788658723.135557:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658723.136543:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788658723.136551:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788658723.137506:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788658723.137516:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788658723.138358:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658723.138528:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788658723.138533:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788658723.139260:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788658723.139268:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788658723.139927:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658723.140186:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788658723.140192:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788658723.140636:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788658723.140643:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788658723.158195:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658723.158446:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788658723.158452:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788658723.159891:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788658723.159903:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788658723.160667:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788658723.160686:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788658723.161499:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788658723.161527:0:22701:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788658723.161533:0:22701:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788658723.161640:0:22701:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788658723.161672:0:22701:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788658723.161688:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788658723.161689:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658723.161691:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658723.161692:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658723.161694:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658723.161695:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658723.161696:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658723.161698:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658723.161700:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658723.161728:0:22701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658723.161731:0:22701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788658723.161733:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658723.161735:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658723.161741:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658723.161742:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658723.161743:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658723.161745:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658723.161746:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658723.161747:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658723.161748:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658723.161749:0:22701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658723.161778:0:22701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788658723.161798:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025306624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788658723.161870:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658723.161912:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3482d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658723.162070:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025306624 00000100:00100000:0.0:1788658723.162078:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025306624 00000100:00100000:0.0:1788658723.162113:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658723.162122:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+5:22701:x1875544025306624:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788658723.162167:0:22717:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788658723.162170:0:22717:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788658723.162173:0:22717:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788658723.162461:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788658723.163072:0:22717:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1788658723.164487:0:22739:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788658723.164494:0:22739:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788658723.164497:0:22739:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788658723.164499:0:22739:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788658723.164686:0:22739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788658723.164932:0:22717:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788658723.164943:0:22717:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788658723.166318:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+5:22701:x1875544025306624:12345-0@lo:253:mount.lustre.0 Request processed in 4188us (4439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658723.166336:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658723.166456:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025306624:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788658723.166471:0:22701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788658723.166474:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658723.166476:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658723.166477:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658723.166478:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658723.166479:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658723.166480:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658723.166482:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658723.166483:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658723.166485:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658723.166486:0:22701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788658723.166505:0:22701:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1d810f6800 from lustre-MDT0000 10000000:01000000:3.0:1788658723.166535:0:22701:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788658723.166539:0:22701:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788658723.166544:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a1eb3974d40 10000000:01000000:3.0:1788658723.166547:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658723.166556:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a1eb3974d40 from 1 10000000:01000000:3.0:1788658723.166559:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788658723.166596:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.166607:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.166616:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658723.166651:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025306752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658723.166700:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658723.166830:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1299c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658723.166935:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025306752 00000100:00100000:2.0:1788658723.166942:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025306752 00000100:00100000:2.0:1788658723.167054:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658723.167065:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+5:22701:x1875544025306752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658723.167078:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658723.167093:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391200/0x48e67cc629c70231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c7022a expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.167116:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391200/0x48e67cc629c70231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c7022a expref: 6 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.167127:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391200/0x48e67cc629c70231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c7022a expref: 6 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.167135:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391200, rc 0) 00000100:00100000:2.0:1788658723.167180:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+6:22701:x1875544025306752:12345-0@lo:101:mount.lustre.0 Request processed in 117us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658723.167187:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658723.167303:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025306752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658723.167317:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.167325:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658723.167393:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025306880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658723.167420:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658723.167441:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1299c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658723.167496:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025306880 00000100:00100000:2.0:1788658723.167500:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025306880 00000100:00100000:2.0:1788658723.167535:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658723.167542:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+6:22701:x1875544025306880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658723.167614:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+6:22701:x1875544025306880:12345-0@lo:501:mount.lustre.0 Request processed in 73us (193us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658723.167621:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658723.167800:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025306880:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788658723.167827:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788658723.167881:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.167889:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658723.167897:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1d810f6800 10000000:01000000:3.0:1788658723.167902:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788658723.167906:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a1d810f6800 10000000:01000000:3.0:1788658723.167908:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788658723.167911:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a1d810f6800 from 1 10000000:01000000:3.0:1788658723.167919:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788658723.167935:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c70238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.167943:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c70238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.167951:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c70238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658723.168044:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025307008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658723.168074:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658723.168105:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1299c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658723.168160:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025307008 00000100:00100000:1.0:1788658723.168166:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025307008 00000100:00100000:1.0:1788658723.168203:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658723.168209:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+6:22701:x1875544025307008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658723.168217:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658723.168230:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b3200/0x48e67cc629c7023f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70238 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.168248:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b3200/0x48e67cc629c7023f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70238 expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.168257:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b3200/0x48e67cc629c7023f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70238 expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.168262:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b3200, rc 0) 00000100:00100000:1.0:1788658723.168300:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+7:22701:x1875544025307008:12345-0@lo:101:mount.lustre.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658723.168306:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658723.168379:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025307008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658723.168389:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c70238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7023f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.168396:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c70238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c7023f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658723.168408:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788658723.168522:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c70238 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7023f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.168529:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c70238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7023f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658723.168534:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788658723.168538:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658723.168549:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a1d810f6800 10000000:01000000:3.0:1788658723.168552:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788658723.168555:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788658723.168557:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788658723.168572:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96600/0x48e67cc629c70246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.168579:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96600/0x48e67cc629c70246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.168587:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96600/0x48e67cc629c70246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658723.168599:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025307136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658723.168623:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658723.168643:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1299c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658723.168726:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025307136 00000100:00100000:1.0:1788658723.168730:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025307136 00000100:00100000:1.0:1788658723.168791:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658723.168799:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+7:22701:x1875544025307136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658723.168806:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658723.168815:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b3c00/0x48e67cc629c7024d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70246 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.168837:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b3c00/0x48e67cc629c7024d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70246 expref: 8 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.168845:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b3c00/0x48e67cc629c7024d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70246 expref: 8 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.168852:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b3c00, rc 0) 00000100:00100000:1.0:1788658723.168886:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+8:22701:x1875544025307136:12345-0@lo:101:mount.lustre.0 Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658723.168896:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658723.168953:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025307136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658723.168974:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96600/0x48e67cc629c70246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7024d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.168981:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96600/0x48e67cc629c70246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c7024d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658723.169033:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025307264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658723.169058:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658723.169242:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb34823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658723.169306:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025307264 00000100:00100000:3.0:1788658723.169310:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025307264 00000100:00100000:3.0:1788658723.169330:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658723.169336:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+8:22701:x1875544025307264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658723.169503:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+9:22701:x1875544025307264:12345-0@lo:501:mount.lustre.0 Request processed in 165us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658723.169510:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658723.169615:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025307264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658723.169643:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025307392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658723.169691:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658723.169804:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb34823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658723.169868:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025307392 00000100:00100000:3.0:1788658723.169872:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025307392 00000100:00100000:3.0:1788658723.169932:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658723.169939:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+9:22701:x1875544025307392:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658723.170555:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+9:22701:x1875544025307392:12345-0@lo:503:mount.lustre.0 Request processed in 614us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658723.170573:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658723.170658:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025307392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658723.171049:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22740:1875544025307520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658723.171094:0:22740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658723.171325:0:22740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658723.171391:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025307520 00000100:00100000:1.0:1788658723.171397:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025307520 00000100:00100000:1.0:1788658723.171432:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658723.171441:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+9:22740:x1875544025307520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658723.172093:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+9:22740:x1875544025307520:12345-0@lo:502:llog_process_th.0 Request processed in 651us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658723.172102:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658723.172206:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22740:1875544025307520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658723.172239:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658723.172251:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658723.172254:0:22740:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788658723.172259:0:22740:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788658723.172262:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788658723.172278:0:22740:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a1e8f2519c0) 00000020:00000080:0.0:1788658723.172296:0:22740:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788658723.172309:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788658723.172401:0:22740:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788658723.172409:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c7025b 00000020:00000080:0.0:1788658723.172642:0:22740:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788658723.172647:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658723.172651:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658723.172652:0:22740:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788658723.172655:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658723.172659:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658723.172660:0:22740:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788658723.172663:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788658723.172670:0:22740:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a1e8f253380) 00000020:00000080:0.0:1788658723.172693:0:22740:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788658723.172698:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788658723.172700:0:22740:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788658723.172740:0:22740:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788658723.172749:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788658723.172795:0:22740:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d810f6800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788658723.172809:0:22740:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a1e8f250000) 00000020:00000080:0.0:1788658723.172818:0:22740:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788658723.172867:0:22740:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788658723.172872:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c70270 00000020:00000080:0.0:1788658723.173045:0:22740:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788658723.173053:0:22740:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788658723.173058:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x48e67cc629c70277 00080000:01000000:0.0:1788658723.173064:0:22740:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788658723.173068:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c7027e 00010000:00010000:1.0:1788658723.239352:0:22740:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788658723.240019:0:22740:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:1.0:1788658723.240309:0:22740:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788658723.240862:0:22740:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a1eb486b380) 00000020:00000080:1.0:1788658723.240883:0:22740:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788658723.240954:0:22740:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788658723.240975:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c7028c 00000020:00000080:1.0:1788658723.241548:0:22740:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788658723.244062:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x48e67cc629c70293 00000020:00000080:2.0:1788658723.250618:0:22740:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788658723.250646:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658723.250654:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658723.250656:0:22740:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788658723.250659:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788658723.250662:0:22740:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788658723.250663:0:22740:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788658723.250665:0:22740:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788658723.250666:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788658723.250668:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658723.250670:0:22740:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788658723.250672:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658723.250690:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658723.250692:0:22740:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788658723.250696:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788658723.250784:0:22740:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788658723.250805:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658723.250808:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658723.250810:0:22740:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788658723.250812:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658723.250816:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658723.250817:0:22740:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788658723.250820:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788658723.250826:0:22740:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:00000080:2.0:1788658723.250860:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658723.250880:0:22740:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a1ebf438000) 00000020:00000080:2.0:1788658723.250900:0:22740:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788658723.250904:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788658723.251188:0:22740:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788658723.251196:0:22740:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788658723.251205:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c702a1 00010000:00080000:2.0:1788658723.251239:0:22740:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb213a800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:2.0:1788658723.253321:0:22740:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788658723.254435:0:22740:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788658723.254453:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788658723.254491:0:22740:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788658723.254515:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c702a8 00000100:00080000:3.0:1788658723.254529:0:22740:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658723.254536:0:22740:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a1eb213a800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658723.254578:0:22740:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d81b38700 x1875544025307648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658723.254610:0:22740:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788658723.254731:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025307648:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788658723.254809:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788658723.254954:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658723.254968:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658723.254970:0:22740:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788658723.254973:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788658723.254976:0:22740:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788658723.254978:0:22740:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658723.254979:0:22740:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658723.254981:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788658723.254983:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658723.254985:0:22740:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788658723.254988:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788658723.254993:0:22740:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788658723.254997:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658723.254998:0:22740:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788658723.255001:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788658723.255006:0:22740:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:3.0:1788658723.255030:0:22740:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788658723.255032:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658723.255045:0:22740:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a1e84454d40) 00000020:00000080:3.0:1788658723.255058:0:22740:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788658723.255072:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788658723.255134:0:22740:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788658723.255140:0:22740:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788658723.255147:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c702b6 00010000:00080000:3.0:1788658723.255178:0:22740:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb2139800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658723.255370:0:22740:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788658723.255882:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025307648 00000100:00100000:3.0:1788658723.255890:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025307648 00000100:00100000:3.0:1788658723.255968:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658723.255976:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025307648:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788658723.255993:0:22727:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788658723.265556:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025307648:12345-0@lo:38:llog_process_th.0 Request processed in 9569us (10737us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788658723.265571:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788658723.265671:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788658723.265688:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788658723.265693:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025307648:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1788658723.267892:0:22740:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788658723.268118:0:22740:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788658723.269617:0:22740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658723.270145:0:22740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788658723.273410:0:22740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788658723.274056:0:22746:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788658723.274061:0:22746:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788658723.274851:0:22740:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788658723.274864:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788658723.274898:0:22740:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788658723.274919:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c702bd 00000100:00080000:3.0:1788658723.274929:0:22740:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658723.274935:0:22740:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1eb2139800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658723.275042:0:22740:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d81b39880 x1875544025307776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658723.275100:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025307776:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788658723.275158:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025307776 offset 0 length 520: 4 00000100:00080000:3.0:1788658723.275212:0:22740:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788658723.275275:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658723.275279:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658723.275281:0:22740:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788658723.275283:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788658723.275286:0:22740:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788658723.275294:0:22740:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658723.275296:0:22740:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658723.275298:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788658723.275300:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658723.275302:0:22740:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788658723.275304:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788658723.275308:0:22740:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788658723.275312:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658723.275313:0:22740:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788658723.275316:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788658723.275320:0:22740:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:3.0:1788658723.275340:0:22740:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788658723.275342:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658723.275353:0:22740:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a1e84450000) 00000020:00000080:3.0:1788658723.275364:0:22740:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788658723.275367:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788658723.275422:0:22740:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788658723.275428:0:22740:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788658723.275433:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c702cb 00010000:00080000:3.0:1788658723.275460:0:22740:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1e86d86000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658723.275661:0:22740:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788658723.275767:0:22740:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788658723.275783:0:22740:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788658723.277344:0:22740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658723.277542:0:22740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788658723.277698:0:22740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788658723.278643:0:22748:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788658723.278654:0:22748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788658723.279839:0:22740:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788658723.279853:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788658723.279893:0:22740:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788658723.279928:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c702d2 00000100:00080000:2.0:1788658723.279940:0:22740:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658723.279946:0:22740:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1e86d86000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658723.280109:0:22740:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83798700 x1875544025307904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658723.280135:0:22740:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788658723.280200:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658723.280204:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658723.280207:0:22740:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788658723.280211:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658723.280215:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658723.280217:0:22740:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658723.280219:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658723.280221:0:22740:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788658723.280224:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658723.280227:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658723.280228:0:22740:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788658723.280230:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658723.280233:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658723.280234:0:22740:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788658723.280239:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788658723.280274:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22740:1875544025308032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658723.280374:0:22740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658723.280411:0:22740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9889bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658723.280501:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025308032 00000100:00100000:1.0:1788658723.280508:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025308032 00000100:00100000:1.0:1788658723.280562:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658723.280572:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+9:22740:x1875544025308032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658723.280728:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+9:22740:x1875544025308032:12345-0@lo:502:llog_process_th.0 Request processed in 157us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658723.280737:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658723.280786:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025307904:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788658723.280813:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025307904 offset 0 length 520: 4 00000100:00100000:2.0:1788658723.281107:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22740:1875544025308032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658723.281136:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658723.281141:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658723.281144:0:22740:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788658723.281147:0:22740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788658723.281322:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788658723.281346:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788658723.281373:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96600/0x48e67cc629c70246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7024d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.281386:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96600/0x48e67cc629c70246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7024d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658723.281402:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1d810f6800 from 1 10000000:01000000:3.0:1788658723.281405:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658723.281432:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.281441:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.281452:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658723.281467:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025308160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658723.281501:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658723.281602:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2156240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658723.281894:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025308160 00000100:00100000:2.0:1788658723.281900:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025308160 00000100:00100000:2.0:1788658723.281947:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658723.282070:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+9:22701:x1875544025308160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658723.282084:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658723.282099:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390800/0x48e67cc629c702e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c702d9 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.282121:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390800/0x48e67cc629c702e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c702d9 expref: 10 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.282131:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390800/0x48e67cc629c702e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c702d9 expref: 10 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.282139:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390800, rc 0) 00000100:00100000:2.0:1788658723.282184:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+10:22701:x1875544025308160:12345-0@lo:101:mount.lustre.0 Request processed in 228us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658723.282190:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658723.282278:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025308160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658723.282294:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.282303:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658723.282885:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025308288:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788658723.282928:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658723.283036:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2156240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658723.283212:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025308288 00000100:00100000:2.0:1788658723.283218:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025308288 00000100:00100000:2.0:1788658723.283245:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658723.283253:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+10:22701:x1875544025308288:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788658723.283278:0:22714:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788658723.283284:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788658723.283383:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+10:22701:x1875544025308288:12345-0@lo:256:mount.lustre.0 Request processed in 130us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658723.283390:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658723.283605:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025308288:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788658723.284368:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788658723.284400:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.284411:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658723.284418:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1d810f6800 from 1 10000000:01000000:3.0:1788658723.284421:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658723.284452:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.284460:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.284469:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658723.284485:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025308416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658723.284527:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658723.284564:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2156240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658723.284774:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025308416 00000100:00100000:2.0:1788658723.284781:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025308416 00000100:00100000:2.0:1788658723.284827:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658723.284835:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+10:22701:x1875544025308416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658723.284847:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658723.284860:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c702ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c702e7 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.284881:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c702ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c702e7 expref: 11 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.284892:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c702ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c702e7 expref: 11 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.284899:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391c00, rc 0) 00000100:00100000:2.0:1788658723.285073:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:22701:x1875544025308416:12345-0@lo:101:mount.lustre.0 Request processed in 237us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658723.285080:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658723.285317:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025308416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658723.285333:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.285343:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658723.285425:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025308544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658723.285456:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658723.285520:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658723.285561:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025308544 00000100:00100000:2.0:1788658723.285565:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025308544 00000100:00100000:2.0:1788658723.285633:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658723.285641:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:22701:x1875544025308544:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658723.285822:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:22701:x1875544025308544:12345-0@lo:501:mount.lustre.0 Request processed in 182us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658723.285836:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658723.285900:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025308544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658723.285938:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025308672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658723.285982:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658723.286372:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658723.286406:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025308672 00000100:00100000:0.0:1788658723.286410:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025308672 00000100:00100000:2.0:1788658723.286458:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658723.286467:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:22701:x1875544025308672:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658723.286558:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:22701:x1875544025308672:12345-0@lo:503:mount.lustre.0 Request processed in 92us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658723.286565:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658723.286640:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025308672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658723.287378:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22750:1875544025308800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658723.287425:0:22750:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658723.287458:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658723.287509:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025308800 00000100:00100000:0.0:1788658723.287516:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025308800 00000100:00100000:0.0:1788658723.287542:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788658723.287549:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:22750:x1875544025308800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658723.288076:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:22750:x1875544025308800:12345-0@lo:502:llog_process_th.0 Request processed in 525us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658723.288085:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658723.288194:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22750:1875544025308800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788658723.288221:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658723.288231:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658723.288234:0:22750:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788658723.288246:0:22750:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1d810f6800 00000020:00000080:1.0:1788658723.288249:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658723.288257:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658723.288260:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658723.288261:0:22750:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788658723.288263:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658723.288265:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658723.288267:0:22750:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788658723.288270:0:22750:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1d810f6800 00000020:00000080:1.0:1788658723.288272:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658723.288334:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658723.288338:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658723.288339:0:22750:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788658723.288342:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658723.288345:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658723.288346:0:22750:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658723.288350:0:22750:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1d810f6800 00000020:00000080:1.0:1788658723.288352:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658723.288368:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658723.288371:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658723.288372:0:22750:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658723.288375:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658723.288377:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658723.288378:0:22750:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788658723.288389:0:22750:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1d810f6800 00000020:00000080:1.0:1788658723.288391:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788658723.288428:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22750:1875544025308928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658723.288465:0:22750:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658723.288488:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658723.288547:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025308928 00000100:00100000:0.0:1788658723.288552:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025308928 00000100:00100000:0.0:1788658723.288575:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658723.288582:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:22750:x1875544025308928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658723.288668:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:22750:x1875544025308928:12345-0@lo:502:llog_process_th.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658723.288684:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658723.289092:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22750:1875544025308928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788658723.289117:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658723.289122:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658723.289124:0:22750:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788658723.289129:0:22750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788658723.290793:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788658723.290835:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658723.290858:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.290871:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658723.290946:0:22701:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788658723.290950:0:22701:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1d810f6800 10000000:01000000:2.0:1788658723.290953:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1d810f6800 10000000:01000000:2.0:1788658723.291074:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658723.291084:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1d810f6800 from 1 10000000:01000000:2.0:1788658723.291087:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788658723.291124:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391e00/0x48e67cc629c702f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.291133:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391e00/0x48e67cc629c702f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.291142:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391e00/0x48e67cc629c702f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658723.291183:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025309056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658723.291250:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658723.291297:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e915d1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658723.291387:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025309056 00000100:00100000:0.0:1788658723.291394:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025309056 00000100:00100000:0.0:1788658723.291443:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788658723.291453:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:22701:x1875544025309056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658723.291467:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658723.291480:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ebf602000/0x48e67cc629c702fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c702f5 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658723.291502:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf602000/0x48e67cc629c702fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c702f5 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658723.291520:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ebf602000/0x48e67cc629c702fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c702f5 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658723.291529:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf602000, rc 0) 00000100:00100000:0.0:1788658723.291566:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22701:x1875544025309056:12345-0@lo:101:mount.lustre.0 Request processed in 114us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658723.291573:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788658723.292221:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025309056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658723.292238:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391e00/0x48e67cc629c702f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c702fc expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.292248:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391e00/0x48e67cc629c702f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c702fc expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658723.292310:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025309184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658723.292338:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658723.292372:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e915d1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658723.292441:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025309184 00000100:00100000:3.0:1788658723.292446:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025309184 00000100:00100000:3.0:1788658723.292478:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658723.292486:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22701:x1875544025309184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658723.292612:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22701:x1875544025309184:12345-0@lo:501:mount.lustre.0 Request processed in 126us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658723.292620:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788658723.292782:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025309184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658723.292806:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025309312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658723.292843:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658723.292860:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e915d1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658723.292927:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025309312 00000100:00100000:1.0:1788658723.292932:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025309312 00000100:00100000:1.0:1788658723.293077:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658723.293086:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22701:x1875544025309312:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658723.293167:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22701:x1875544025309312:12345-0@lo:503:mount.lustre.0 Request processed in 83us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658723.293174:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658723.293291:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025309312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658723.294454:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22752:1875544025309440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658723.294510:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658723.294547:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e915d1600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658723.294590:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025309440 00000100:00100000:1.0:1788658723.294596:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025309440 00000100:00100000:1.0:1788658723.294636:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658723.294644:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22752:x1875544025309440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658723.294787:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22752:x1875544025309440:12345-0@lo:502:llog_process_th.0 Request processed in 143us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658723.294794:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788658723.294878:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22752:1875544025309440:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788658723.294947:0:22752:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788658723.294977:0:22752:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a1ebf4399c0) 00000020:00000080:2.0:1788658723.294997:0:22752:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788658723.295077:0:22752:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d810f6800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788658723.295081:0:22752:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1d810f6800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788658723.295083:0:22752:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1d810f6800 4 00010000:00080000:2.0:1788658723.295118:0:22752:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1e86d84800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:2.0:1788658723.296808:0:22752:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788658723.296999:0:22752:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788658723.297039:0:22752:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788658723.297052:0:22752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x48e67cc629c7030a 00000100:00080000:2.0:1788658723.297063:0:22752:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658723.297069:0:22752:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a1e86d84800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658723.297103:0:22752:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d8379b480 x1875544025309568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658723.297132:0:22752:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788658723.297334:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025309568:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658723.297395:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658723.298062:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22752:1875544025309696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658723.298107:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658723.298132:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025309696 00000100:00100000:1.0:1788658723.298138:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025309696 00000100:00100000:1.0:1788658723.298174:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658723.298183:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22752:x1875544025309696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658723.298290:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22752:x1875544025309696:12345-0@lo:502:llog_process_th.0 Request processed in 108us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658723.298298:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658723.298341:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658723.298359:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22752:1875544025309696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658723.298394:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22752:1875544025309824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658723.298423:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658723.298443:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025309824 00000100:00100000:1.0:1788658723.298447:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025309824 00000100:00100000:1.0:1788658723.298468:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788658723.298474:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22752:x1875544025309824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658723.298529:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22752:x1875544025309824:12345-0@lo:502:llog_process_th.0 Request processed in 56us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658723.298535:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788658723.298562:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658723.298574:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22752:1875544025309824:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788658723.298593:0:22752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788658723.298786:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788658723.298809:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788658723.298836:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391e00/0x48e67cc629c702f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c702fc expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.298846:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391e00/0x48e67cc629c702f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c702fc expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788658723.298890:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788658723.298892:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658723.298893:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658723.298894:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658723.298896:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658723.298897:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658723.298898:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658723.298900:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658723.298901:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658723.298903:0:22701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788658723.298907:0:22701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788658723.298909:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788658723.298911:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658723.298912:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658723.298913:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658723.298914:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658723.298927:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658723.298929:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658723.298930:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658723.298931:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658723.298932:0:22701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788658723.298947:0:22701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788658723.298956:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025309952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788658723.299156:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658723.299185:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2156900 going to sleep for 11 seconds 00000100:00100000:1.0:1788658723.299264:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025309952 00000100:00100000:1.0:1788658723.299269:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025309952 00000100:00100000:1.0:1788658723.299342:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788658723.299350:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22701:x1875544025309952:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788658723.299372:0:22717:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788658723.299384:0:22717:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788658723.300183:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025309568 00000100:00100000:2.0:1788658723.300192:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025309568 00000100:00100000:2.0:1788658723.300223:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658723.300230:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875544025309568:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788658723.300300:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875544025309568:12345-0@lo:38:llog_process_th.0 Request processed in 70us (2904us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788658723.300307:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658723.300347:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658723.300355:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e86d84800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658723.300359:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788658723.300362:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025309568:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788658723.304198:0:22717:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788658723.304223:0:22717:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788658723.304489:0:22738:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788658723.304495:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788658723.304517:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658723.304537:0:22738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3390800/0x48e67cc629c702e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c702d9 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658723.304545:0:22738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658723.304584:0:22738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3390800/0x48e67cc629c702e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c702d9 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658723.304597:0:22738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb3390800/0x48e67cc629c702e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c702d9 expref: 12 pid: 22717 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658723.304612:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025310080:0@lo:104: 00000100:00100000:0.0:1788658723.304687:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658723.304765:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2168c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658723.305129:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025310080 00000100:00100000:2.0:1788658723.305137:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025310080 00000100:00100000:2.0:1788658723.305190:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658723.305200:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:22738:x1875544025310080:12345-0@lo:104: 00010000:00010000:2.0:1788658723.305214:0:22705:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658723.305279:0:22705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658723.305285:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:22738:x1875544025310080:12345-0@lo:104: Request processed in 87us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658723.305292:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658723.305352:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22701:x1875544025309952:12345-0@lo:253:mount.lustre.0 Request processed in 6003us (6195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658723.305360:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788658723.305431:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025310080:0@lo:104: 00010000:00010000:0.0:1788658723.305452:0:22738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.307910:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658723.308022:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.308035:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97000 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658723.308047:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.308059:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658723.308067:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658723.308073:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658723.308129:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.308136:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658723.308158:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.308164:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c702d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c702e0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658723.308182:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658723.308184:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658723.308186:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658723.308237:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025310208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658723.308298:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658723.308407:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22701:1875544025309952:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788658723.308421:0:22701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788658723.308424:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658723.308426:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658723.308427:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658723.308434:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658723.308436:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658723.308437:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658723.308439:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658723.308440:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658723.308442:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658723.308444:0:22701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788658723.308458:0:22701:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788658723.309140:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025310208 00000100:00100000:1.0:1788658723.309149:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025310208 00010000:00010000:1.0:1788658723.309181:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3390800/0x48e67cc629c702e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c702d9 expref: 12 pid: 22717 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658723.309216:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658723.309226:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:3647:x1875544025310208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658723.309240:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658723.309246:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3390800/0x48e67cc629c702e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c702d9 expref: 12 pid: 22717 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.309257:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3390800/0x48e67cc629c702e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c702d9 expref: 12 pid: 22717 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.309273:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390800/0x48e67cc629c702e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c702d9 expref: 12 pid: 22717 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.309288:0:22707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.309297:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788658723.309314:0:22707:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004819664s 00010000:00010000:1.0:1788658723.309319:0:22707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.309337:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.309344:0:22707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.309350:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.309356:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658723.309360:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.309368:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.309392:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658723.309403:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658723.309457:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:3647:x1875544025310208:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658723.309464:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788658723.311112:0:22738:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658723.311127:0:22738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658723.311133:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c70311 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658723.320841:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025310208:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788658723.332381:0:22701:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000020:00080000:2.0:1788658723.332767:0:22761:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1788658723.332772:0:22761:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:3.0:1788658723.332804:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788658723.333183:0:22762:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788658723.333443:0:22762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788658723.334067:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:2.0:1788658723.337067:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788658723.337109:0:22701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658723.337562:0:22762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788658723.337630:0:22762:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:3.0:1788658723.338318:0:22763:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8a1d81b38000 x1875544025310336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658723.338332:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00000004:00000080:2.0:1788658723.338829:0:22701:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788658723.338840:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788658723.338910:0:22701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658723.340799:0:22701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788658723.341374:0:22701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788658723.341407:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788658723.342203:0:22701:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788658723.342874:0:22701:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1788658723.345058:0:22701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788658723.346488:0:22701:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788658723.346523:0:22701:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa33e41c2f988 00100000:10000000:3.0:1788658723.346531:0:22701:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788658723.348118:0:22701:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788658723.348137:0:22701:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788658723.348158:0:22701:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788658723.348172:0:22701:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788658723.349160:0:22701:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658723.349287:0:22701:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788658724.039786:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658724.352073:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00000040:00080000:0.0:1788658724.353805:0:22758:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788658724.353815:0:22758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658724.355826:0:22758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788658724.355841:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1788658724.863300:0:22719:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788658724.863316:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1d810f6800 from 11 10000000:01000000:1.0:1788658724.863323:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788658724.863380:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658724.863392:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658724.863404:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658724.863443:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025310464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658724.864650:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658724.864743:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658724.867117:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025310464 00000100:00100000:2.0:1788658724.867137:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025310464 00000100:00100000:2.0:1788658724.867224:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788658724.867239:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+11:22719:x1875544025310464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658724.867260:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658724.867287:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c7031f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70318 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658724.867324:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c7031f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70318 expref: 12 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658724.867337:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c7031f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70318 expref: 12 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658724.867349:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391800, rc 0) 00000100:00100000:2.0:1788658724.867451:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22719:x1875544025310464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658724.867459:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788658724.867533:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025310464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658724.867554:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658724.867566:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658724.867653:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025310592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788658724.867739:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658724.867777:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3453c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658724.867799:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025310592 00000100:00100000:2.0:1788658724.867803:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025310592 00000100:00100000:2.0:1788658724.867831:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658724.867837:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22719:x1875544025310592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788658724.867853:0:22717:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788658724.867872:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788658724.867876:0:22717:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788658724.868026:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:22719:x1875544025310592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 187us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658724.868034:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658724.868068:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025310592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788658724.868114:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788658724.868121:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658724.868130:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658725.060374:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658725.374846:0:22758:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788658725.374855:0:22758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658725.374970:0:22758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788658725.375019:0:22758:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658725.375155:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788658725.375311:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:1.0:1788658726.080874:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658726.400453:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:1.0:1788658727.103672:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658727.428201:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00000001:02000400:0.0:1788658727.483412:0:23007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788658728.128067:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788658728.365653:0:23059:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658728.366454:0:23059:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1788658728.383402:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788658728.383410:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788658728.383414:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658728.383424:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:3.0:1788658728.383430:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788658728.383437:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a1eb213a800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658728.383460:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d81b3aa00 x1875544025310848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658728.383477:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658728.383480:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658728.383483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658728.383500:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658728.383502:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788658728.383506:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788658728.383508:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1e86d84800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658728.383514:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a1e86d84800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658728.383528:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d81b3bb80 x1875544025310976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658728.383550:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658728.383576:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025310720:0@lo:400:kworker.0 00000100:00100000:3.0:1788658728.383649:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658728.388994:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025310848:0@lo:38:kworker.0 00000100:00100000:2.0:1788658728.389117:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658728.390962:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025310720 00000100:00100000:0.0:1788658728.390976:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025310720 00000100:00100000:0.0:1788658728.391045:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025310848 00000100:00100000:0.0:1788658728.391049:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025310848 00000100:00100000:0.0:1788658728.391115:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658728.391125:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875544025310848:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788658728.391149:0:22728:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788658728.391327:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875544025310848:12345-0@lo:38:kworker.0 Request processed in 202us (2209us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788658728.391336:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658728.391411:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658728.391418:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:3647:x1875544025310720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658728.391468:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:3647:x1875544025310720:12345-0@lo:400:kworker.0 Request processed in 51us (7818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658728.391474:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658728.391589:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025310720:0@lo:400:kworker.0 00000100:00080000:2.0:1788658728.396746:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658728.396759:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788658728.396764:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025310848:0@lo:38:kworker.0 00000100:00100000:2.0:1788658728.396778:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025310976:0@lo:38:kworker.0 00000100:00100000:2.0:1788658728.396848:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658728.399271:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025310976 00000100:00100000:1.0:1788658728.399283:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025310976 00000100:00100000:1.0:1788658728.399321:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658728.399329:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025310976:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788658728.399356:0:22724:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:1.0:1788658728.399393:0:22724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x48e67cc629c70326 00000004:00100000:1.0:1788658728.399410:0:22724:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788658728.399537:0:22724:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdaec000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658728.399613:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875544025310976:12345-0@lo:38:kworker.0 Request processed in 284us (2764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658728.399620:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788658728.404147:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1d81b3bb80 x1875544025310976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658728.404172:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788658728.404182:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788658728.404824:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788658728.404830:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e86d84800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788658728.404839:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025310976:0@lo:38:kworker.0 00000100:00100000:0.0:1788658728.448076:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:1.0:1788658729.151942:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788658729.437799:0:23109:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658729.438083:0:23109:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788658729.473375:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:1.0:1788658730.174873:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658730.497175:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:1.0:1788658731.199956:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658731.520155:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:1.0:1788658732.226060:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658732.557623:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:2.0:1788658733.246871:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658733.513634:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658723/real 1788658723] req@ffff8a1d83798700 x1875544025307904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658733 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658733.513675:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d83798700 x1875544025307904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658733 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658733.513686:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658723/real 1788658723] req@ffff8a1d81b39880 x1875544025307776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658733 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658733.513747:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d81b39880 x1875544025307776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658733 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658733.513767:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e86d86000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658733.513780:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788658733.513784:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025307904:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788658733.513790:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb2139800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658733.513794:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788658733.513797:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025307776:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788658733.515427:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788658733.515433:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788658733.515437:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658733.515444:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 645 00000100:00080000:2.0:1788658733.515449:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788658733.515456:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a1eb213a800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658733.515476:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d8379bb80 x1875544025311232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658733.515492:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658733.515495:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788658733.515496:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1eb2139800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658733.515499:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:2.0:1788658733.515502:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788658733.515505:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1eb2139800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658733.515516:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d8379b800 x1875544025311360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658733.515524:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658733.515526:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788658733.515528:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1e86d86000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658733.515531:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:2.0:1788658733.515534:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788658733.515547:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1e86d86000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658733.515560:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d8379ad80 x1875544025311488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658733.515622:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025311104:0@lo:400:kworker.0 00000100:00100000:2.0:1788658733.515696:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658733.515768:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658733.515774:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025311616:0@lo:400:kworker.0 00000100:00100000:2.0:1788658733.515802:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658733.515852:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025311104 00000100:00100000:2.0:1788658733.515859:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025311104 00000100:00100000:2.0:1788658733.515904:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658733.515914:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:3649:x1875544025311104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658733.515963:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:3649:x1875544025311104:12345-0@lo:400:kworker.0 Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658733.515970:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658733.516034:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025311104:0@lo:400:kworker.0 00000100:00100000:2.0:1788658733.516055:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025311232:0@lo:38:kworker.0 00000100:00100000:2.0:1788658733.516081:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658733.516100:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025311360:0@lo:8:kworker.0 00000400:00000100:2.0:1788658733.516137:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025311360 offset 0 length 520: 4 00000100:00100000:2.0:1788658733.516150:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025311488:0@lo:8:kworker.0 00000400:00000100:2.0:1788658733.516167:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025311488 offset 0 length 520: 4 00000100:00100000:2.0:1788658733.516192:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025311232 00000100:00100000:2.0:1788658733.516196:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025311232 00000100:00100000:2.0:1788658733.516219:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658733.516223:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025311232:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788658733.516240:0:22727:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788658733.517209:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025311232:12345-0@lo:38:kworker.0 Request processed in 44us (186us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788658733.517219:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788658733.517251:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658733.517254:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788658733.517257:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025311232:0@lo:38:kworker.0 00000100:00100000:1.0:1788658733.518526:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025311616 00000100:00100000:1.0:1788658733.518537:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025311616 00000100:00100000:1.0:1788658733.518579:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658733.518588:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025311616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658733.518678:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025311616:12345-0@lo:400:kworker.0 Request processed in 92us (2875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658733.518696:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788658733.519902:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1d83798e00 x1875544025311616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658733.519921:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025311616:0@lo:400:kworker.0 00000100:00100000:2.0:1788658733.571378:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:0.0:1788658734.272425:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658734.592298:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:2.0:1788658735.299901:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658735.619897:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788658735.621623:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00000020:01000004:1.0:1788658736.047669:0:23454:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788658736.047674:0:23454:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788658736.047676:0:23454:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788658736.048797:0:23454:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1ebdc0b000 00000020:01000004:0.0:1788658736.048818:0:23454:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788658736.048831:0:23454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788658736.048846:0:23454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8a1e8f254d40) 00000020:00000080:0.0:1788658736.048861:0:23454:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788658736.101563:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788658736.101848:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788658736.104172:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788658736.104543:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788658736.104774:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788658736.105106:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788658736.105367:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788658736.105595:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788658736.106203:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788658736.106399:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788658736.107068:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788658736.107785:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788658736.109402:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788658736.109682:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788658736.113122:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.113393:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.113647:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.114142:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.114343:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.114540:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.114941:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.115366:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.115582:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.116100:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.116372:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.116575:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.116979:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.117394:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.117606:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.117856:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.118352:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.118543:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.118788:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.119204:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.119459:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.119635:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.120102:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.120396:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.120671:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.121172:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.121435:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.121630:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.122164:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.122366:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788658736.122570:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788658736.122783:0:23454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00080000:01000000:3.0:1788658736.123653:0:23454:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788658736.124060:0:23454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788658736.124073:0:23454:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788658736.124084:0:23454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c70334 00000020:01000004:3.0:1788658736.124091:0:23454:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788658736.124113:0:23454:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788658736.124116:0:23454:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788658736.124122:0:23454:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788658736.124147:0:23454:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788658736.124151:0:23454:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788658736.130159:0:23454:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788658736.130207:0:23454:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.153@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788658736.130212:0:23454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788658736.130213:0:23454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788658736.130215:0:23454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658736.130216:0:23454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658736.130217:0:23454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658736.130218:0:23454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658736.130220:0:23454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658736.130221:0:23454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658736.130223:0:23454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788658736.130226:0:23454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788658736.130228:0:23454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788658736.130229:0:23454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788658736.130230:0:23454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658736.130231:0:23454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658736.130232:0:23454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658736.130233:0:23454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658736.130234:0:23454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658736.130235:0:23454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658736.130237:0:23454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788658736.130517:0:23454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788658736.130540:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025311744:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788658736.130629:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658736.130804:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788658736.131081:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025311744 00000100:00100000:2.0:1788658736.131096:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025311744 00000100:00100000:2.0:1788658736.131206:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788658736.131217:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:23454:x1875544025311744:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788658736.131251:0:22717:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788658736.131255:0:22717:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788658736.131263:0:22717:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788658736.131607:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:23454:x1875544025311744:12345-0@lo:253:mount.lustre.0 Request processed in 391us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658736.131615:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788658736.131743:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025311744:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788658736.131756:0:23454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788658736.131759:0:23454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658736.131761:0:23454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788658736.131762:0:23454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658736.131763:0:23454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658736.131764:0:23454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658736.131766:0:23454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658736.131767:0:23454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658736.131769:0:23454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658736.131770:0:23454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788658736.131790:0:23454:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1ebdc0b000 from lustre-MDT0001 10000000:01000000:3.0:1788658736.131835:0:23454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788658736.131845:0:23454:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788658736.131853:0:23454:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a1eb3974d40 local copy 00010000:00010000:3.0:1788658736.131864:0:23454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658736.131994:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025311872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658736.132024:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658736.132446:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658736.132522:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025311872 00000100:00100000:0.0:1788658736.132529:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025311872 00000100:00100000:0.0:1788658736.132562:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658736.132570:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:23454:x1875544025311872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658736.132667:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:23454:x1875544025311872:12345-0@lo:501:mount.lustre.0 Request processed in 97us (642us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788658736.132675:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788658736.132807:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025311872:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788658736.132824:0:23454:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788658736.132846:0:23454:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788658736.132853:0:23454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658736.132862:0:23454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658736.132900:0:23454:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1ebdc0b000 10000000:01000000:3.0:1788658736.132905:0:23454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788658736.132910:0:23454:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a1eb3974d40 10000000:01000000:3.0:1788658736.132912:0:23454:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788658736.132916:0:23454:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a1eb3974d40 from 1 10000000:01000000:3.0:1788658736.132928:0:23454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788658736.132953:0:23454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c7033b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658736.132961:0:23454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c7033b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658736.132991:0:23454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c7033b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658736.133008:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658736.133037:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658736.133056:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658736.133317:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025312000 00000100:00100000:0.0:1788658736.133323:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025312000 00000100:00100000:0.0:1788658736.133343:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658736.133349:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+12:23454:x1875544025312000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658736.133358:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658736.133370:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ebf602c00/0x48e67cc629c70342 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c7033b expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.133390:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf602c00/0x48e67cc629c70342 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c7033b expref: 13 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.133399:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ebf602c00/0x48e67cc629c70342 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c7033b expref: 13 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.133408:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf602c00, rc 0) 00000100:00100000:0.0:1788658736.133445:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+13:23454:x1875544025312000:12345-0@lo:101:mount.lustre.0 Request processed in 95us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.133451:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788658736.133522:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658736.133535:0:23454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c7033b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70342 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658736.133544:0:23454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c7033b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70342 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658736.133560:0:23454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788658736.133579:0:23454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c7033b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70342 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658736.133588:0:23454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c7033b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70342 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658736.133596:0:23454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a1ebdc0b000 10000000:01000000:3.0:1788658736.133599:0:23454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788658736.133603:0:23454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a1ebdc0b000 from 1 10000000:01000000:3.0:1788658736.133605:0:23454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788658736.133620:0:23454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c70349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658736.133626:0:23454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c70349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658736.133652:0:23454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c70349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658736.133666:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658736.133693:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658736.133738:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658736.133804:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025312128 00000100:00100000:0.0:1788658736.133809:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025312128 00000100:00100000:0.0:1788658736.133829:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658736.133835:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+13:23454:x1875544025312128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658736.133842:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658736.133850:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ebf603e00/0x48e67cc629c70350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70349 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.133888:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf603e00/0x48e67cc629c70350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70349 expref: 14 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.133897:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ebf603e00/0x48e67cc629c70350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70349 expref: 14 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.133905:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf603e00, rc 0) 00000100:00100000:0.0:1788658736.134162:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+14:23454:x1875544025312128:12345-0@lo:101:mount.lustre.0 Request processed in 326us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.134168:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788658736.134366:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658736.134378:0:23454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c70349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70350 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658736.134387:0:23454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c70349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70350 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658736.134398:0:23454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788658736.134413:0:23454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c70349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70350 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658736.134421:0:23454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c70349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70350 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658736.134426:0:23454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788658736.134430:0:23454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658736.134434:0:23454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a1ebdc0b000 10000000:01000000:3.0:1788658736.134437:0:23454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788658736.134440:0:23454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788658736.134441:0:23454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788658736.134456:0:23454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c70357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658736.134470:0:23454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c70357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658736.134479:0:23454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c70357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658736.134492:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658736.134518:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658736.134540:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658736.134622:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025312256 00000100:00100000:2.0:1788658736.134627:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025312256 00000100:00100000:2.0:1788658736.134671:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788658736.134677:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+14:23454:x1875544025312256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658736.134684:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658736.134693:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c7035e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70357 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.134728:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c7035e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70357 expref: 15 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.134737:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c7035e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70357 expref: 15 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.134743:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390200, rc 0) 00000100:00100000:2.0:1788658736.134785:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+15:23454:x1875544025312256:12345-0@lo:101:mount.lustre.0 Request processed in 108us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.134903:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658736.134914:0:23454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c70357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7035e expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.134933:0:23454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c70357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c7035e expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658736.135469:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000040:00080000:0.0:1788658736.136654:0:23454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1788658736.139387:0:23454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658736.145266:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788658736.145327:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788658736.145341:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788658736.145353:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788658736.145365:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788658736.145377:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788658736.145388:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788658736.145400:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788658736.145412:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788658736.145424:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788658736.145436:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788658736.145450:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788658736.145474:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788658736.145488:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788658736.145498:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788658736.145509:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788658736.145520:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788658736.145530:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788658736.145541:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788658736.145551:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788658736.145562:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788658736.145572:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788658736.145583:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788658736.145595:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788658736.145605:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1788658736.145615:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1788658736.145626:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1788658736.145650:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1788658736.145663:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1788658736.145674:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1788658736.145684:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1788658736.145694:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1788658736.145739:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1788658736.145752:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1788658736.145762:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1788658736.145773:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1788658736.145783:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1788658736.145803:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1788658736.145816:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1788658736.145828:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1788658736.145839:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1788658736.145851:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1788658736.145864:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1788658736.145875:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1788658736.145899:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1788658736.145910:0:23454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1788658736.146032:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658736.146097:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658736.146132:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658736.146469:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025312384 00000100:00100000:2.0:1788658736.146477:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025312384 00000100:00100000:2.0:1788658736.146540:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658736.146549:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+15:23454:x1875544025312384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658736.146722:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+15:23454:x1875544025312384:12345-0@lo:501:mount.lustre.0 Request processed in 152us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658736.146730:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788658736.147301:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658736.147345:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658736.147394:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658736.147471:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658736.148106:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025312512 00000100:00100000:2.0:1788658736.148113:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025312512 00000100:00100000:2.0:1788658736.148189:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658736.148199:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+15:23454:x1875544025312512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658736.149330:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+15:23454:x1875544025312512:12345-0@lo:503:mount.lustre.0 Request processed in 1129us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658736.149340:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788658736.149440:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312512:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788658736.149979:0:23454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658736.150083:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658736.150141:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658736.151126:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025312640 00000100:00100000:0.0:1788658736.151137:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025312640 00000100:00100000:0.0:1788658736.151181:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788658736.151191:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+15:23454:x1875544025312640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658736.151463:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90294900 going to sleep for 11 seconds 00000100:00100000:1.0:1788658736.153115:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+15:23454:x1875544025312640:12345-0@lo:502:mount.lustre.0 Request processed in 1916us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658736.153128:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658736.153221:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658736.153486:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788658736.153516:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788658736.153529:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788658736.153542:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788658736.153553:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788658736.153564:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788658736.153575:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788658736.153586:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788658736.153598:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788658736.153608:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788658736.153620:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788658736.153632:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788658736.153662:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788658736.153676:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788658736.153689:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788658736.154090:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788658736.154126:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788658736.154141:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788658736.154154:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788658736.154166:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1788658736.154177:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1788658736.154191:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1788658736.154204:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1788658736.154223:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1788658736.154238:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1788658736.154252:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1788658736.154264:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1788658736.154278:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1788658736.154290:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1788658736.154303:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1788658736.154316:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1788658736.154331:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1788658736.154346:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1788658736.154361:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1788658736.154376:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1788658736.154391:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1788658736.154406:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1788658736.154421:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1788658736.154436:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1788658736.154454:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1788658736.154469:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1788658736.154491:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1788658736.154507:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1788658736.154521:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1788658736.154565:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658736.154632:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658736.154764:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e91ca0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658736.155202:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025312768 00000100:00100000:1.0:1788658736.155210:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025312768 00000100:00100000:1.0:1788658736.155303:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788658736.155314:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+15:23454:x1875544025312768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658736.155462:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+15:23454:x1875544025312768:12345-0@lo:502:mount.lustre.0 Request processed in 149us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658736.155469:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788658736.155547:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025312768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658736.155611:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1788658736.155621:0:23454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788658736.157369:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658736.157388:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658736.157390:0:23458:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788658736.157397:0:23458:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788658736.157399:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658736.157413:0:23458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8a1ebf43cd40) 00000020:00000080:2.0:1788658736.157435:0:23458:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788658736.157439:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788658736.157519:0:23458:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658736.157526:0:23458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c7036c 00000020:00000080:2.0:1788658736.158201:0:23458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788658736.158207:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658736.158212:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658736.158214:0:23458:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788658736.158217:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658736.158220:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658736.158221:0:23458:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788658736.158224:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658736.158232:0:23458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8a1ebf43b380) 00000020:00000080:2.0:1788658736.158244:0:23458:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788658736.158248:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788658736.158250:0:23458:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788658736.158253:0:23458:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788658736.158258:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788658736.158307:0:23458:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1ebdc0b000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788658736.158321:0:23458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8a1eb23f0000) 00000020:00000080:2.0:1788658736.158330:0:23458:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788658736.158400:0:23458:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788658736.158408:0:23458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c70381 00000020:00000080:2.0:1788658736.158502:0:23458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788658736.158509:0:23458:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788658736.158513:0:23458:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x48e67cc629c70388 00080000:01000000:2.0:1788658736.158520:0:23458:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788658736.158523:0:23458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c7038f 00010000:00010000:2.0:1788658736.256625:0:23458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788658736.257552:0:23458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788658736.258280:0:23458:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788658736.259762:0:23458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788658736.259776:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658736.259783:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658736.259785:0:23458:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788658736.259789:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658736.259806:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658736.259808:0:23458:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788658736.259812:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788658736.259817:0:23458:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:00000080:3.0:1788658736.259846:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658736.259863:0:23458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8a1e84453380) 00000020:00000080:3.0:1788658736.259896:0:23458:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788658736.259901:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788658736.260307:0:23458:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788658736.260316:0:23458:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788658736.260323:0:23458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c7039d 00010000:00080000:3.0:1788658736.260379:0:23458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb1d6d000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.153@tcp at head 00010000:00010000:2.0:1788658736.266322:0:23458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788658736.269248:0:23458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788658736.269265:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788658736.269302:0:23458:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788658736.269328:0:23458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c703a4 00000100:00080000:3.0:1788658736.269340:0:23458:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658736.269346:0:23458:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a1eb1d6d000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658736.269383:0:23458:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d81b3bb80 x1875544025312896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658736.269411:0:23458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788658736.269469:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658736.269473:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658736.269474:0:23458:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788658736.269477:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788658736.269480:0:23458:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788658736.269481:0:23458:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658736.269483:0:23458:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658736.269484:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788658736.269486:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658736.269487:0:23458:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788658736.269490:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658736.269494:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658736.269495:0:23458:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788658736.269498:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788658736.269529:0:23458:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788658736.269542:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658736.269545:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658736.269546:0:23458:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788658736.269548:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788658736.269550:0:23458:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788658736.269551:0:23458:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658736.269552:0:23458:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658736.269554:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788658736.269563:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658736.269565:0:23458:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788658736.269568:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788658736.269571:0:23458:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788658736.269574:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658736.269575:0:23458:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788658736.269578:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788658736.269581:0:23458:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:3.0:1788658736.269606:0:23458:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788658736.269608:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658736.269620:0:23458:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a1e844519c0) 00000020:00000080:3.0:1788658736.269631:0:23458:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788658736.269646:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788658736.269742:0:23458:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788658736.269749:0:23458:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788658736.269756:0:23458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c703b2 00010000:00080000:3.0:1788658736.269789:0:23458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb740b000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.153@tcp at head 00000100:00080000:1.0:1788658736.269900:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788658736.269904:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788658736.269914:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658736.269927:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 650 00000100:00080000:1.0:1788658736.269932:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788658736.269936:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a1eb213a800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658736.269953:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb98700 x1875544025313024/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658736.269964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658736.269967:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658736.269970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658736.269973:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788658736.270027:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025313152:0@lo:400:kworker.0 00000100:00100000:1.0:1788658736.270092:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658736.270143:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025313152 00000100:00100000:1.0:1788658736.270150:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025313152 00000100:00100000:1.0:1788658736.270189:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658736.270198:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025313152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658736.270246:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025313152:12345-0@lo:400:kworker.0 Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658736.270253:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788658736.270289:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1ebdb99880 x1875544025313152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658736.270303:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025313152:0@lo:400:kworker.0 00010000:00010000:3.0:1788658736.270783:0:23458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1788658736.270927:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025312896:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788658736.270967:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658736.271010:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025313024:0@lo:38:kworker.0 00000100:00100000:2.0:1788658736.271032:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658736.271061:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025312896 00000100:00100000:2.0:1788658736.271065:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025312896 00000100:00100000:2.0:1788658736.271080:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025313024 00000100:00100000:2.0:1788658736.271082:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025313024 00000100:00100000:2.0:1788658736.271091:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658736.271098:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025312896:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788658736.271118:0:22727:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:2.0:1788658736.271149:0:22727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c703b9 00000004:00100000:2.0:1788658736.271162:0:22727:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788658736.271168:0:22727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:3.0:1788658736.272587:0:23458:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788658736.274077:0:23458:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788658736.282560:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658736.283265:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788658736.283435:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788658736.285784:0:23463:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000020:00000080:2.0:1788658736.287294:0:23458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788658736.287309:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788658736.287355:0:23458:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788658736.287378:0:23458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c703c0 00000100:00080000:2.0:1788658736.287390:0:23458:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658736.287396:0:23458:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a1eb740b000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658736.287431:0:23458:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83799c00 x1875544025313280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658736.287455:0:23458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788658736.287521:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658736.287531:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658736.287533:0:23458:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788658736.287537:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788658736.287539:0:23458:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788658736.287541:0:23458:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788658736.287543:0:23458:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788658736.287544:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788658736.287546:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658736.287548:0:23458:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788658736.287551:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788658736.287555:0:23458:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788658736.287558:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658736.287559:0:23458:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788658736.287562:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788658736.287566:0:23458:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:2.0:1788658736.287591:0:23458:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788658736.287593:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658736.287605:0:23458:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a1eb23f19c0) 00000020:00000080:2.0:1788658736.287619:0:23458:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788658736.287624:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788658736.287740:0:23458:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788658736.287748:0:23458:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788658736.287755:0:23458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c703ce 00010000:00080000:2.0:1788658736.287785:0:23458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1ebdb65800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.153@tcp at head 00000040:00080000:1.0:1788658736.288549:0:23463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:1.0:1788658736.288573:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658736.288577:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658736.288580:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658736.288583:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788658736.288738:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025313280:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788658736.288796:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025313280 offset 0 length 520: 4 00000100:00080000:0.0:1788658736.289290:0:22727:0:(import.c:65:import_set_state_nolock()) ffff8a1eabc57000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658736.289360:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875544025312896:12345-0@lo:38:llog_process_th.0 Request processed in 18260us (18391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.289370:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658736.289402:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658736.289408:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025313024:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788658736.289447:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025313024:12345-0@lo:38:kworker.0 Request processed in 38us (18415us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788658736.289452:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658736.289568:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658736.289577:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788658736.289585:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788658736.289590:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788658736.289592:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb1d6d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788658736.289614:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025312896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658736.289650:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658736.289655:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658736.289658:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788658736.289661:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025313024:0@lo:38:kworker.0 00000100:00100000:0.0:1788658736.290206:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025313408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658736.290248:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658736.290394:0:23458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788658736.290464:0:23458:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788658736.290479:0:23458:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788658736.290917:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025313408 00000100:00100000:3.0:1788658736.290935:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025313408 00000100:00100000:3.0:1788658736.291106:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658736.291119:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875544025313408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658736.291152:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788658736.291221:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875544025313408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658736.291228:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658736.291833:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025313408:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788658736.294134:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658736.294377:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788658736.294511:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788658736.295222:0:23465:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788658736.295228:0:23465:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788658736.295876:0:23458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788658736.295899:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788658736.295949:0:23458:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788658736.295978:0:23458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c703d5 00000100:00080000:2.0:1788658736.296000:0:23458:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658736.296007:0:23458:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ebdb65800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658736.296044:0:23458:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d8379b100 x1875544025313536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658736.296068:0:23458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788658736.296119:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658736.296123:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658736.296125:0:23458:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788658736.296129:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658736.296134:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658736.296135:0:23458:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658736.296138:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658736.296140:0:23458:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788658736.296142:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658736.296144:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658736.296145:0:23458:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788658736.296147:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658736.296149:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658736.296151:0:23458:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788658736.296154:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788658736.296177:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658736.296179:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658736.296181:0:23458:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788658736.296184:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1788658736.296245:0:23454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788658736.296276:0:23454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788658736.296289:0:23454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c70357 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7035e expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.296299:0:23454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c70357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7035e expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658736.296318:0:23454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ebdc0b000 from 1 10000000:01000000:2.0:1788658736.296321:0:23454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788658736.296347:0:23454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.296355:0:23454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.296366:0:23454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658736.296385:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025313664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658736.296449:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658736.296483:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478d80 going to sleep for 11 seconds 00000100:00080000:0.0:1788658736.296849:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658736.296854:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658736.296857:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658736.296859:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788658736.296939:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025313536:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788658736.296975:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025313536 offset 0 length 520: 4 00000100:00100000:1.0:1788658736.297029:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025313664 00000100:00100000:1.0:1788658736.297036:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025313664 00000100:00100000:1.0:1788658736.297085:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788658736.297095:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+15:23454:x1875544025313664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658736.297119:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658736.297133:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c703e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c703dc expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658736.297159:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c703e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c703dc expref: 16 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658736.297169:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c703e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c703dc expref: 16 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658736.297178:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b3600, rc 0) 00000100:00100000:1.0:1788658736.297218:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+16:23454:x1875544025313664:12345-0@lo:101:mount.lustre.0 Request processed in 125us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658736.297225:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788658736.297290:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025313664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658736.297305:0:23454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658736.297315:0:23454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658736.297949:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025313792:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788658736.297998:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658736.298021:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e902943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658736.298171:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025313792 00000100:00100000:0.0:1788658736.298176:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025313792 00000100:00100000:0.0:1788658736.298216:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788658736.298225:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+16:23454:x1875544025313792:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788658736.298242:0:22717:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788658736.298294:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788658736.298298:0:22717:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788658736.298385:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+16:23454:x1875544025313792:12345-0@lo:256:mount.lustre.0 Request processed in 161us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.298393:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788658736.298436:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025313792:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788658736.299098:0:23454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788658736.299121:0:23454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.299131:0:23454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658736.299139:0:23454:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ebdc0b000 from 1 10000000:01000000:0.0:1788658736.299141:0:23454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658736.299168:0:23454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.299177:0:23454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.299186:0:23454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658736.299201:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025313920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658736.299230:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658736.299255:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260900 going to sleep for 11 seconds 00000100:00100000:1.0:1788658736.299628:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025313920 00000100:00100000:1.0:1788658736.299634:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025313920 00000100:00100000:1.0:1788658736.299690:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788658736.299699:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+16:23454:x1875544025313920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658736.299741:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658736.299753:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b2e00/0x48e67cc629c703f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c703ea expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658736.299773:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b2e00/0x48e67cc629c703f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c703ea expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658736.299782:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b2e00/0x48e67cc629c703f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c703ea expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658736.299790:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2e00, rc 0) 00000100:00100000:1.0:1788658736.299833:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:23454:x1875544025313920:12345-0@lo:101:mount.lustre.0 Request processed in 135us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658736.299839:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788658736.299953:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025313920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658736.299965:0:23454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.299974:0:23454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658736.301293:0:23454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788658736.301567:0:23454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658736.301803:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788658736.301829:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788658736.301846:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788658736.301863:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788658736.301876:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788658736.302280:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788658736.302300:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788658736.302313:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788658736.302328:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788658736.302343:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788658736.302358:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788658736.302377:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788658736.302383:0:23454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788658736.302467:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658736.302533:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658736.302619:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658736.302673:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025314048 00000100:00100000:1.0:1788658736.302680:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025314048 00000100:00100000:0.0:1788658736.303417:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658736.303431:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:23454:x1875544025314048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658736.303576:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:23454:x1875544025314048:12345-0@lo:501:mount.lustre.0 Request processed in 148us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.303584:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788658736.303680:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658736.303745:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658736.303794:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658736.303997:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90294900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658736.304193:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025314176 00000100:00100000:2.0:1788658736.304200:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025314176 00000100:00100000:2.0:1788658736.304234:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658736.304242:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:23454:x1875544025314176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658736.304344:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:23454:x1875544025314176:12345-0@lo:503:mount.lustre.0 Request processed in 102us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658736.304352:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658736.304509:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314176:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788658736.305017:0:23454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658736.305095:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658736.305138:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658736.305161:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90294900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658736.305382:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025314304 00000100:00100000:2.0:1788658736.305387:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025314304 00000100:00100000:2.0:1788658736.305414:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788658736.305421:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:23454:x1875544025314304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658736.305522:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:23454:x1875544025314304:12345-0@lo:502:mount.lustre.0 Request processed in 101us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658736.305530:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788658736.305611:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658736.306076:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788658736.306105:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1788658736.306120:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1788658736.306131:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1788658736.306143:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1788658736.306159:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1788658736.306173:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1788658736.306185:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1788658736.306198:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788658736.306212:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1788658736.306224:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1788658736.306249:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658736.306288:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658736.306350:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90294900 going to sleep for 11 seconds 00000100:00100000:0.0:1788658736.306418:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025314432 00000100:00100000:0.0:1788658736.306423:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025314432 00000100:00100000:3.0:1788658736.306519:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788658736.306530:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:23454:x1875544025314432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658736.306616:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:23454:x1875544025314432:12345-0@lo:502:mount.lustre.0 Request processed in 89us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658736.306624:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788658736.306789:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658736.306831:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1788658736.306840:0:23454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788658736.307604:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658736.307614:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658736.307616:0:23467:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788658736.307624:0:23467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1ebdc0b000 00000020:00000080:1.0:1788658736.307627:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658736.307634:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658736.307648:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658736.307649:0:23467:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788658736.307652:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658736.307654:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658736.307655:0:23467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788658736.307659:0:23467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1ebdc0b000 00000020:00000080:1.0:1788658736.307661:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658736.307846:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658736.307851:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658736.307852:0:23467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788658736.307856:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658736.307859:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658736.307860:0:23467:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658736.307864:0:23467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1ebdc0b000 00000020:00000080:1.0:1788658736.307866:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658736.308794:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658736.308800:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658736.308802:0:23467:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658736.308807:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658736.308810:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658736.308812:0:23467:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788658736.308815:0:23467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1ebdc0b000 00000020:00000080:1.0:1788658736.308817:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658736.308853:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658736.308856:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658736.308857:0:23467:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788658736.308861:0:23467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1788658736.314257:0:23454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788658736.314308:0:23454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658736.315803:0:23454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.315820:0:23454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658736.315890:0:23454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788658736.315894:0:23454:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1ebdc0b000 10000000:01000000:0.0:1788658736.315898:0:23454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1ebdc0b000 10000000:01000000:0.0:1788658736.315902:0:23454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658736.315908:0:23454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ebdc0b000 from 1 10000000:01000000:0.0:1788658736.315911:0:23454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658736.315950:0:23454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603400/0x48e67cc629c703f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.315959:0:23454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603400/0x48e67cc629c703f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.315971:0:23454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603400/0x48e67cc629c703f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658736.316008:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658736.316078:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658736.316123:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025314560 00000100:00100000:0.0:1788658736.316130:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025314560 00000100:00100000:0.0:1788658736.316172:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788658736.316181:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:23454:x1875544025314560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658736.316193:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658736.316206:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ebf603000/0x48e67cc629c703ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c703f8 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.316242:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf603000/0x48e67cc629c703ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c703f8 expref: 18 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.316253:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ebf603000/0x48e67cc629c703ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c703f8 expref: 18 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.316262:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf603000, rc 0) 00000100:00100000:0.0:1788658736.316296:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025314560:12345-0@lo:101:mount.lustre.0 Request processed in 116us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.316303:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788658736.316350:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788658736.316373:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658736.316388:0:23454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603400/0x48e67cc629c703f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c703ff expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.316398:0:23454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603400/0x48e67cc629c703f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c703ff expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.320322:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658736.320693:0:23454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1788658736.321227:0:23454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658736.321422:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1788658736.321447:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1788658736.321463:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1788658736.321477:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1788658736.321490:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1788658736.321504:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1788658736.321517:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1788658736.321531:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1788658736.321559:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1788658736.321576:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1788658736.321590:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1788658736.321603:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1788658736.321616:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1788658736.321631:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1788658736.321660:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1788658736.321674:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1788658736.321688:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1788658736.321778:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1788658736.321797:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1788658736.321812:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1788658736.321828:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1788658736.321844:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1788658736.321863:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1788658736.321879:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1788658736.321891:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1788658736.321903:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1788658736.321915:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1788658736.322071:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1788658736.322090:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1788658736.322105:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1788658736.322124:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1788658736.322142:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1788658736.322160:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1788658736.322175:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1788658736.322189:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1788658736.322206:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1788658736.322223:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1788658736.322239:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1788658736.322256:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1788658736.322273:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1788658736.322290:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1788658736.322320:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1788658736.322338:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1788658736.322359:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1788658736.322375:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1788658736.322391:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1788658736.322410:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1788658736.322427:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1788658736.322567:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1788658736.322590:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1788658736.322610:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1788658736.322615:0:23454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1788658736.322804:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658736.322875:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658736.323105:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e812edf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658736.323164:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025314688 00000100:00100000:3.0:1788658736.323174:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025314688 00000100:00100000:3.0:1788658736.323263:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788658736.323275:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025314688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658736.323423:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025314688:12345-0@lo:501:mount.lustre.0 Request processed in 150us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658736.323432:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788658736.323500:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658736.323531:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658736.323567:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658736.323580:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e812edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658736.323594:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025314816 00000100:00100000:0.0:1788658736.323597:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025314816 00000100:00100000:0.0:1788658736.323617:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788658736.323623:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025314816:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658736.323746:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025314816:12345-0@lo:503:mount.lustre.0 Request processed in 78us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.323753:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788658736.323817:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314816:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788658736.324379:0:23454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658736.324455:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658736.324498:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658736.324526:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658736.324546:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025314944 00000100:00100000:0.0:1788658736.324551:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025314944 00000100:00100000:0.0:1788658736.324580:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788658736.324588:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025314944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658736.324685:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025314944:12345-0@lo:502:mount.lustre.0 Request processed in 97us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.324692:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788658736.324769:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025314944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658736.325080:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788658736.325112:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1788658736.325132:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1788658736.325151:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1788658736.325167:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1788658736.325180:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1788658736.325194:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1788658736.325208:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1788658736.325221:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788658736.325237:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1788658736.325250:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1788658736.325262:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1788658736.325275:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1788658736.325290:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1788658736.325318:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1788658736.325335:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1788658736.325346:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1788658736.325360:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1788658736.325385:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1788658736.325397:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1788658736.325408:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1788658736.325420:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1788658736.325431:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1788658736.325442:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1788658736.325454:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1788658736.325466:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1788658736.325478:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1788658736.325490:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1788658736.325502:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1788658736.325515:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1788658736.325545:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1788658736.325561:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1788658736.325572:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1788658736.325586:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1788658736.325602:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1788658736.325617:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1788658736.325631:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1788658736.325659:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1788658736.325673:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1788658736.325688:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1788658736.325732:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1788658736.325751:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1788658736.325768:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1788658736.325784:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1788658736.325800:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1788658736.325816:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1788658736.325844:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1788658736.325861:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1788658736.325899:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025315072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658736.326208:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658736.326267:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025315072 00000100:00100000:0.0:1788658736.326273:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025315072 00000100:00100000:0.0:1788658736.326315:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788658736.326324:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025315072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658736.326426:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025315072:12345-0@lo:502:mount.lustre.0 Request processed in 102us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.326433:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788658736.326488:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658736.326508:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025315072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658736.326695:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1788658736.326745:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1788658736.326773:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025315200:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658736.326818:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658736.326841:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658736.326896:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025315200 00000100:00100000:3.0:1788658736.326901:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025315200 00000100:00100000:3.0:1788658736.326941:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788658736.326949:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025315200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658736.327175:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025315200:12345-0@lo:502:mount.lustre.0 Request processed in 226us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658736.327183:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788658736.327277:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025315200:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658736.327327:0:23454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1788658736.327337:0:23454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788658736.330891:0:23472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788658736.330911:0:23472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8a1d821b8000) 00000020:00000080:3.0:1788658736.330947:0:23472:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788658736.331104:0:23472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1ebdc0b000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788658736.331109:0:23472:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1ebdc0b000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788658736.331112:0:23472:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1ebdc0b000 3 00010000:00080000:3.0:1788658736.331143:0:23472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1d83d5f800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658736.336113:0:23472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788658736.336395:0:23472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788658736.336440:0:23472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788658736.336455:0:23472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x48e67cc629c7040d 00000100:00080000:3.0:1788658736.336465:0:23472:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658736.336472:0:23472:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a1d83d5f800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658736.336508:0:23472:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d81b39f80 x1875544025315328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658736.336542:0:23472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788658736.336625:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658736.336630:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658736.336633:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658736.336646:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788658736.337805:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:1.0:1788658736.338375:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875544025315328:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658736.338445:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658736.338503:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025315328 00000100:00100000:1.0:1788658736.338510:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025315328 00000100:00100000:1.0:1788658736.338541:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658736.338548:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025315328:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788658736.338573:0:22724:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:1.0:1788658736.338614:0:22724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x48e67cc629c70414 00000004:00100000:1.0:1788658736.338627:0:22724:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788658736.338670:0:22724:0:(import.c:65:import_set_state_nolock()) ffff8a1e86d83000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658736.338764:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875544025315328:12345-0@lo:38:llog_process_th.0 Request processed in 215us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658736.338772:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:1.0:1788658736.338802:0:23454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788658736.338837:0:23454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788658736.338853:0:23454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603400/0x48e67cc629c703f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c703ff expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658736.338865:0:23454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603400/0x48e67cc629c703f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c703ff expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788658736.338919:0:23454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788658736.339057:0:23454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788658736.339060:0:23454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658736.339061:0:23454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658736.339062:0:23454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658736.339064:0:23454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658736.339065:0:23454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788658736.339066:0:23454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658736.339068:0:23454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788658736.339073:0:23454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788658736.339075:0:23454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788658736.339076:0:23454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788658736.339077:0:23454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658736.339078:0:23454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658736.339079:0:23454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658736.339080:0:23454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658736.339081:0:23454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788658736.339082:0:23454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658736.339084:0:23454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788658736.339102:0:23454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788658736.339117:0:23454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025315456:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788658736.339154:0:23454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658736.339179:0:23454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90294900 going to sleep for 11 seconds 00010000:00080000:1.0:1788658736.339226:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d81b39f80 x1875544025315328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658736.339235:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658736.339242:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788658736.339248:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788658736.339252:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788658736.339255:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d83d5f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788658736.339260:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875544025315328:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658736.339774:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025315456 00000100:00100000:1.0:1788658736.339782:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025315456 00000100:00100000:1.0:1788658736.340590:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788658736.340600:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025315456:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788658736.340627:0:22714:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788658736.340658:0:22714:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788658736.355343:0:22702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788658736.355594:0:22714:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788658736.355607:0:22714:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788658736.355628:0:22738:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788658736.355651:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788658736.355673:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.355692:0:22738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c7031f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70318 expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.355700:0:22738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c703e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c703dc expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.355743:0:22738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.355870:0:22738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c703e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c703dc expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.355911:0:22738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c703e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c703dc expref: 18 pid: 22715 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658736.355929:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025315584:0@lo:104: 00000100:00100000:0.0:1788658736.356134:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658736.356185:0:22738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c7031f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c70318 expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356194:0:22738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c7031f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c70318 expref: 18 pid: 22715 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658736.356203:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025315712:0@lo:104: 00000100:00100000:0.0:1788658736.356225:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658736.356243:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658736.356262:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:23454:x1875544025315456:12345-0@lo:253:mount.lustre.0 Request processed in 15663us (17107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.356267:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025315584 00000100:00100000:2.0:1788658736.356272:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788658736.356273:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025315584 00000100:00100000:0.0:1788658736.356302:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025315712 00000100:00100000:0.0:1788658736.356304:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025315712 00000100:00100000:0.0:1788658736.356316:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658736.356322:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+4:22738:x1875544025315584:12345-0@lo:104: 00000100:00100000:2.0:1788658736.356328:0:23454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:23454:1875544025315456:0@lo:253:mount.lustre.0 00010000:00010000:0.0:1788658736.356334:0:22705:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658736.356337:0:23454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788658736.356341:0:23454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658736.356342:0:23454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788658736.356344:0:23454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658736.356345:0:23454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658736.356346:0:23454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658736.356347:0:23454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658736.356349:0:23454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658736.356350:0:23454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658736.356351:0:23454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788658736.356368:0:23454:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788658736.356375:0:22705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658736.356380:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+4:22738:x1875544025315584:12345-0@lo:104: Request processed in 58us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.356386:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658736.356400:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658736.356412:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:22738:x1875544025315712:12345-0@lo:104: 00010000:00010000:0.0:1788658736.356419:0:22705:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356449:0:22705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788658736.356453:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:22738:x1875544025315712:12345-0@lo:104: Request processed in 43us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.356459:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788658736.356473:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658736.356478:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356484:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658736.356488:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356496:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658736.356503:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658736.356508:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658736.356534:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356541:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658736.356560:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356577:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c703dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c703e3 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356587:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658736.356590:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356596:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658736.356599:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356607:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658736.356612:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658736.356617:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658736.356629:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356634:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658736.356658:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356665:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2400/0x48e67cc629c70318 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c7031f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356677:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658736.356683:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658736.356684:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658736.356690:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658736.356727:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025315840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658736.356755:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658736.356782:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658736.356788:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025315968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658736.356808:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658736.356839:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025315840 00000100:00100000:0.0:1788658736.356843:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025315840 00010000:00010000:0.0:1788658736.356859:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c703e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c703dc expref: 18 pid: 22715 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658736.356879:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025315968 00000100:00100000:0.0:1788658736.356882:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025315968 00010000:00010000:0.0:1788658736.356892:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c7031f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c70318 expref: 19 pid: 22715 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658736.356904:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658736.356910:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:3649:x1875544025315840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658736.356933:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658736.356939:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c703e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c703dc expref: 19 pid: 22715 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356949:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c703e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c703dc expref: 19 pid: 22715 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.356963:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658736.357688:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:3649:x1875544025315840:12345-0@lo:103:ldlm_bl.0 Request processed in 775us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.357734:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658736.357754:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658736.357762:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:3649:x1875544025315968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658736.357771:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658736.357776:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c7031f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c70318 expref: 18 pid: 22715 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.357785:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c7031f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c70318 expref: 18 pid: 22715 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.357923:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c703e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c703dc expref: 18 pid: 22715 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658736.357934:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025315584:0@lo:104: 00000100:00100000:2.0:1788658736.357956:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025315712:0@lo:104: 00010000:00010000:2.0:1788658736.358003:0:22738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.358043:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c7031f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c70318 expref: 17 pid: 22715 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.358055:0:22707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.358062:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788658736.358087:0:22707:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004819664s 00010000:00010000:0.0:1788658736.358091:0:22707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.358096:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.358100:0:22707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.358104:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.358112:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658736.358116:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.358120:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.358266:0:22738:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658736.358272:0:22738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.358292:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.358297:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c7041b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658736.358306:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658736.358330:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+16:3649:x1875544025315968:12345-0@lo:103:ldlm_bl.0 Request processed in 571us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.358335:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658736.358511:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025315968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658736.358521:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025315840:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1788658736.363432:0:23454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788658736.363434:0:23478:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788658736.363438:0:23478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788658736.363647:0:23479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788658736.363648:0:23454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788658736.364107:0:23479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658736.365863:0:23479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788658736.365945:0:23479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788658736.366443:0:23480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23480:1875544025316096:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788658736.366501:0:23480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658736.366534:0:23480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788658736.366545:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025316096 00000100:00100000:0.0:1788658736.366553:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025316096 00000100:00100000:0.0:1788658736.366605:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658736.366615:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23480:x1875544025316096:12345-0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788658736.366698:0:23454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1788658736.366732:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23480:x1875544025316096:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 118us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.366740:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:2.0:1788658736.366758:0:23454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788658736.367135:0:23454:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788658736.367142:0:23454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788658736.367173:0:23454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788658736.367764:0:23480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23480:1875544025316096:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788658736.367796:0:23480:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788658736.367828:0:23480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23480:1875544025316224:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788658736.367867:0:23480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658736.367892:0:23480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a180 going to sleep for 11 seconds 00000040:00080000:2.0:1788658736.367954:0:23454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1788658736.367971:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025316224 00000100:00100000:1.0:1788658736.367976:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025316224 00000100:00100000:1.0:1788658736.368019:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658736.368027:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23480:x1875544025316224:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788658736.368134:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23480:x1875544025316224:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 108us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658736.368141:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658736.368322:0:23480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23480:1875544025316224:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788658736.368372:0:23480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23480:1875544025316352:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788658736.368400:0:23480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658736.368426:0:23480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a180 going to sleep for 11 seconds 00000040:00080000:2.0:1788658736.368484:0:23454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788658736.368515:0:23454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:0.0:1788658736.368553:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025316352 00000100:00100000:0.0:1788658736.368559:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025316352 00000100:00100000:0.0:1788658736.368595:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658736.368602:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23480:x1875544025316352:12345-0@lo:900:lod0001_rec0000.0 00000040:00080000:2.0:1788658736.368625:0:23454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658736.368686:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23480:x1875544025316352:12345-0@lo:900:lod0001_rec0000.0 Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658736.368692:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788658736.369016:0:23480:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d81b39f80 x1875544025316352/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788658752 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658736.369038:0:23480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23480:1875544025316352:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788658736.369085:0:23480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23480:1875544025316480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788658736.369124:0:23480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658736.369148:0:23480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a300 going to sleep for 11 seconds 00080000:10000000:2.0:1788658736.369321:0:23454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:1.0:1788658736.369749:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025316480 00000100:00100000:1.0:1788658736.369755:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025316480 00000100:00100000:1.0:1788658736.369801:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658736.369815:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23480:x1875544025316480:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788658736.369886:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23480:x1875544025316480:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 72us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658736.369894:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658736.370175:0:23480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23480:1875544025316480:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788658736.370218:0:23480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:1.0:1788658736.371297:0:23454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:0.0:1788658736.374138:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788658736.374218:0:23480:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788658736.374224:0:23480:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1788658736.380453:0:23454:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788658736.380496:0:23454:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa33e4178b988 00100000:10000000:1.0:1788658736.380506:0:23454:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788658736.381321:0:23454:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788658736.381356:0:23454:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788658736.381378:0:23454:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788658736.381402:0:23454:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788658736.382758:0:23454:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658736.382992:0:23454:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788658736.638785:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:2.0:1788658737.346744:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658737.407602:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788658737.599231:0:22719:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788658737.599294:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ebdc0b000 from 12 10000000:01000000:0.0:1788658737.599299:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788658737.599343:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658737.599352:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658737.599361:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658737.599381:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025316608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658737.599450:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658737.599534:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658737.599732:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025316608 00000100:00100000:2.0:1788658737.599741:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025316608 00000100:00100000:2.0:1788658737.599851:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788658737.599861:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+16:22719:x1875544025316608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658737.599884:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658737.599908:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c70429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70422 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658737.599973:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c70429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70422 expref: 17 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658737.599984:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c70429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70422 expref: 17 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658737.599992:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391a00, rc 0) 00000100:00100000:2.0:1788658737.600049:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:22719:x1875544025316608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658737.600056:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788658737.600138:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025316608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658737.600174:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658737.600184:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658737.600247:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025316736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788658737.600284:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658737.602248:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658737.602436:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025316736 00000100:00100000:1.0:1788658737.602446:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025316736 00000100:00100000:1.0:1788658737.602493:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658737.602502:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:22719:x1875544025316736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788658737.602523:0:22717:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788658737.602546:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788658737.602549:0:22717:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788658737.603080:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:22719:x1875544025316736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 577us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658737.603090:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788658737.603228:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025316736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788658737.603279:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788658737.603289:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658737.603299:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658737.603310:0:22719:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788658737.603312:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1d810f6800 from 12 10000000:01000000:0.0:1788658737.603315:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788658737.603341:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658737.603349:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658737.603358:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658737.603387:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025316864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658737.603479:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658737.603506:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658737.603553:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025316864 00000100:00100000:2.0:1788658737.603558:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025316864 00000100:00100000:2.0:1788658737.603621:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788658737.603628:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:22719:x1875544025316864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658737.603648:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658737.603660:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391000/0x48e67cc629c70437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70430 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658737.603681:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391000/0x48e67cc629c70437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70430 expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658737.603691:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391000/0x48e67cc629c70437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70430 expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658737.603699:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391000, rc 0) 00000100:00100000:2.0:1788658737.603754:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:22719:x1875544025316864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658737.603769:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788658737.603838:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025316864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658737.603849:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658737.603859:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658737.604053:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025316992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788658737.604080:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658737.604170:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658737.604260:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025316992 00000100:00100000:1.0:1788658737.604265:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025316992 00000100:00100000:1.0:1788658737.604288:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788658737.604302:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:22719:x1875544025316992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788658737.604316:0:22717:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788658737.604330:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788658737.604333:0:22717:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788658737.604569:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:22719:x1875544025316992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 267us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658737.604576:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788658737.604668:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025316992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788658737.604767:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788658737.604775:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658737.604784:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658737.662836:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:0.0:1788658738.369129:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658738.436989:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788658738.691894:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:0.0:1788658739.394834:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658739.711515:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00010000:00010000:2.0:1788658740.420690:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658740.745584:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 0 seconds 00000001:02000400:3.0:1788658740.919015:0:23722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788658741.439204:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658741.695283:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025317120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658741.695354:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658741.695460:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025317120 00000100:00100000:3.0:1788658741.695468:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025317120 00000100:00100000:3.0:1788658741.695524:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658741.695535:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025317120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658741.695573:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788658741.695636:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025317120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658741.695643:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658741.695685:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025317120:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788658741.696848:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788658741.696854:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788658741.696865:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658741.696875:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a1eb213a800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658741.696898:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb9bb80 x1875544025317376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658741.697104:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658741.697107:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658741.697111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658741.697114:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658741.697141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658741.697144:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658741.697146:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658741.697169:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788658741.697205:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025317504:0@lo:400:kworker.0 00000100:00100000:1.0:1788658741.697258:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658741.697298:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658741.697303:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025317632:0@lo:400:kworker.0 00000100:00100000:1.0:1788658741.697321:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658741.697348:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025317504 00000100:00100000:1.0:1788658741.697354:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025317504 00000100:00100000:1.0:1788658741.697389:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025317632 00000100:00100000:1.0:1788658741.697391:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025317632 00000100:00100000:1.0:1788658741.697403:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658741.697410:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025317504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658741.697450:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025317504:12345-0@lo:400:kworker.0 Request processed in 40us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658741.697456:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658741.697469:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658741.697474:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025317632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658741.697495:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025317632:12345-0@lo:400:kworker.0 Request processed in 21us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658741.697500:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658741.697650:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025317248:0@lo:400:kworker.0 00000100:00100000:3.0:1788658741.697687:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658741.697748:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025317376:0@lo:38:kworker.0 00000100:00100000:3.0:1788658741.697792:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658741.697825:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025317248 00000100:00100000:3.0:1788658741.697829:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025317248 00000100:00100000:3.0:1788658741.698073:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788658741.698082:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:3648:x1875544025317248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658741.698123:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:3648:x1875544025317248:12345-0@lo:400:kworker.0 Request processed in 43us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658741.698138:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788658741.698189:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025317248:0@lo:400:kworker.0 00000100:00100000:3.0:1788658741.698219:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025317376 00000100:00100000:3.0:1788658741.698222:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025317376 00000100:00100000:3.0:1788658741.698243:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658741.698248:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025317376:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788658741.698274:0:22727:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:3.0:1788658741.698310:0:22727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c7043e 00000004:00100000:3.0:1788658741.698327:0:22727:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788658741.698334:0:22727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:1.0:1788658741.698497:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1ebdb99500 x1875544025317632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658741.698510:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025317632:0@lo:400:kworker.0 00010000:00080000:1.0:1788658741.698926:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1ebdb9a300 x1875544025317504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658741.698953:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025317504:0@lo:400:kworker.0 00000100:00080000:2.0:1788658741.719175:0:22727:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdea6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658741.719291:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875544025317376:12345-0@lo:38:kworker.0 Request processed in 21039us (21506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658741.719302:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788658741.719453:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788658741.719462:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788658741.719468:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788658741.719471:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788658741.719491:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000600f8b8): req@ffff8a1d81b38000 x1875544025310336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658741.719680:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658741.719733:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260300 going to sleep for 11 seconds 00000100:00100000:3.0:1788658741.720196:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025317376:0@lo:38:kworker.0 00000100:00100000:3.0:1788658741.720228:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025310336 00000100:00100000:3.0:1788658741.720235:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025310336 00000100:00100000:3.0:1788658741.720286:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658741.720296:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22763:x1875544025310336:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788658741.720383:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22763:x1875544025310336:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658741.720390:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658741.720432:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22763:1875544025310336:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788658741.720466:0:22763:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788658741.720510:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22763:1875544025317760:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788658741.720557:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658741.720574:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82a89cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658741.720584:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025317760 00000100:00100000:3.0:1788658741.720598:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025317760 00000100:00100000:3.0:1788658741.720616:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658741.720632:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22763:x1875544025317760:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788658741.720756:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22763:x1875544025317760:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 134us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658741.720763:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658741.722303:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658741.722331:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025317888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658741.722407:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658741.722468:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025317888 00000100:00100000:2.0:1788658741.722479:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025317888 00000100:00100000:2.0:1788658741.722527:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658741.722537:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875544025317888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658741.722575:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788658741.722643:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875544025317888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658741.722650:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658741.722690:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025317888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658741.723262:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22763:1875544025317760:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788658741.723394:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22763:1875544025318016:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788658741.723438:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658741.723470:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82a89cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658741.726432:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025318016 00000100:00100000:2.0:1788658741.726451:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025318016 00000100:00100000:2.0:1788658741.726528:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658741.726541:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22763:x1875544025318016:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788658741.726736:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22763:x1875544025318016:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 197us (3296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658741.726753:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658741.727093:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22763:1875544025318016:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788658741.727161:0:22763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658741.731764:0:22763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788658741.731884:0:22763:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:3.0:1788658741.731891:0:22763:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1788658741.919998:0:23775:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658741.920185:0:23775:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788658742.463031:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788658742.785206:0:23825:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658742.785418:0:23825:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788658743.489742:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788658743.850760:0:23873:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd3bb65a0 20000000:00000080:1.0:1788658743.850780:0:23873:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1e90635000 uarg=0000000000000000 20000000:01000000:1.0:1788658743.850824:0:23873:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788658743.850833:0:23873:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788658743.850838:0:23873:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788658743.851550:0:23874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788658743.851635:0:23873:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788658743.856525:0:23873:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788658743.856561:0:23873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658743.856580:0:23873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c702ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c702e7 expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658743.856588:0:23873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb23b2e00/0x48e67cc629c703f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c703ea expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658743.856596:0:23873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658743.856655:0:23873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb23b2e00/0x48e67cc629c703f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c703ea expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658743.856673:0:23873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb23b2e00/0x48e67cc629c703f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c703ea expref: 17 pid: 22714 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658743.856690:0:23873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23873:1875544025318144:0@lo:104: 00000100:00100000:1.0:1788658743.856808:0:23873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658743.856882:0:23873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c702ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c702e7 expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658743.856891:0:23873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c702ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c702e7 expref: 17 pid: 22717 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658743.856915:0:23873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23873:1875544025318272:0@lo:104: 00000100:00100000:1.0:1788658743.856940:0:23873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658743.856956:0:23873:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658743.857343:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025318144 00000100:00100000:0.0:1788658743.857352:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025318144 00000100:00100000:0.0:1788658743.857396:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025318272 00000100:00100000:0.0:1788658743.857399:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025318272 00000100:00100000:0.0:1788658743.857414:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658743.857423:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+4:23873:x1875544025318144:12345-0@lo:104: 00010000:00010000:0.0:1788658743.857437:0:22705:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857512:0:22705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658743.857519:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+4:23873:x1875544025318144:12345-0@lo:104: Request processed in 97us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658743.857525:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658743.857544:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658743.857551:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:23873:x1875544025318272:12345-0@lo:104: 00010000:00010000:0.0:1788658743.857559:0:22705:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857592:0:22705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788658743.857597:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:23873:x1875544025318272:12345-0@lo:104: Request processed in 48us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658743.857603:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788658743.857633:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658743.857638:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857645:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf602200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658743.857649:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857669:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658743.857675:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658743.857681:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788658743.857744:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857751:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658743.857768:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857774:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c703ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c703f1 expref: -99 pid: 23454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857788:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658743.857791:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857796:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658743.857798:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857805:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658743.857811:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658743.857822:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788658743.857836:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857841:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658743.857857:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857864:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c702e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c702ee expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.857877:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658743.857879:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658743.857881:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658743.858098:0:23873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23873:1875544025318144:0@lo:104: 00000100:00100000:1.0:1788658743.858107:0:23873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23873:1875544025318272:0@lo:104: 00010000:00010000:1.0:1788658743.858128:0:23873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658743.858279:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658743.858368:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025318528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658743.858651:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025318400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658743.858733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658743.858885:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025318400 00000100:00100000:1.0:1788658743.858892:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025318400 00010000:00010000:1.0:1788658743.858927:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb23b2e00/0x48e67cc629c703f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c703ea expref: 18 pid: 22714 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658743.858960:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658743.858968:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:3648:x1875544025318400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658743.858980:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658743.858986:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb23b2e00/0x48e67cc629c703f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c703ea expref: 18 pid: 22714 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658743.858997:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb23b2e00/0x48e67cc629c703f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c703ea expref: 18 pid: 22714 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658743.859013:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b2e00/0x48e67cc629c703f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c703ea expref: 18 pid: 22714 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658743.859041:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658743.859081:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:3648:x1875544025318400:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658743.859088:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658743.859154:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025318400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658743.859260:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658743.859693:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025318528 00000100:00100000:3.0:1788658743.859843:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025318528 00010000:00010000:3.0:1788658743.859867:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c702ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c702e7 expref: 17 pid: 22717 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658743.859906:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658743.859915:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:3649:x1875544025318528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658743.859924:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658743.859929:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c702ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c702e7 expref: 17 pid: 22717 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.859940:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c702ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c702e7 expref: 17 pid: 22717 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.859952:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c702ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c702e7 expref: 17 pid: 22717 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.859967:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.859975:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.859990:0:22709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.859998:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.860004:0:22709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.860012:0:22709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.860024:0:22709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658743.860029:0:22709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.860037:0:22709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.860228:0:23873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658743.860236:0:23873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.868076:0:22709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.868096:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c70445 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658743.868122:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658743.868217:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+16:3649:x1875544025318528:12345-0@lo:103:ldlm_bl.0 Request processed in 8300us (8953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658743.868226:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658743.868366:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025318528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658744.510877:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788658745.087783:0:22719:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658745.087792:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ebdc0b000 from 13 10000000:01000000:0.0:1788658745.087798:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658745.087844:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658745.087857:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658745.087876:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658745.087905:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025318656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658745.087974:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658745.088028:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658745.088055:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025318656 00000100:00100000:3.0:1788658745.088062:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025318656 00000100:00100000:3.0:1788658745.088121:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788658745.088131:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+16:22719:x1875544025318656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658745.088144:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658745.088156:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c70453 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c7044c expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658745.088189:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c70453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c7044c expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658745.088200:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c70453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c7044c expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658745.088217:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97400, rc 0) 00000100:00100000:3.0:1788658745.088266:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:22719:x1875544025318656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658745.088273:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788658745.088296:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025318656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658745.088311:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658745.088320:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658745.088391:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025318784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658745.088416:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658745.088442:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658745.088463:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025318784 00000100:00100000:3.0:1788658745.088467:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025318784 00000100:00100000:3.0:1788658745.088498:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788658745.088505:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:22719:x1875544025318784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658745.088627:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:22719:x1875544025318784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658745.088634:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788658745.088646:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025318784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658745.088671:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025318912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658745.088742:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658745.088761:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658745.088885:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025318912 00000100:00100000:3.0:1788658745.088889:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025318912 00000100:00100000:3.0:1788658745.088918:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788658745.088924:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec20ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:22719:x1875544025318912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658745.089005:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec20ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:22719:x1875544025318912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658745.089011:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788658745.089487:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025318912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788658745.091070:0:23930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788658745.094923:0:22719:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788658745.094965:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788658745.094977:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658745.094989:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658745.095001:0:22719:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788658745.095004:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1d810f6800 from 13 10000000:01000000:1.0:1788658745.095007:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658745.095047:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658745.095056:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658745.095067:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658745.095095:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025319040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658745.095220:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658745.095265:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96840 going to sleep for 11 seconds 00000100:00100000:3.0:1788658745.097002:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025319040 00000100:00100000:3.0:1788658745.097013:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025319040 00000100:00100000:3.0:1788658745.097072:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788658745.097082:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec20cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+17:22719:x1875544025319040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658745.097097:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658745.097115:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70461 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c7045a expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658745.097152:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c7045a expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658745.097162:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c7045a expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658745.097171:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96a00, rc 0) 00000100:00100000:3.0:1788658745.097238:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec20cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:22719:x1875544025319040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658745.097245:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788658745.097297:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025319040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658745.097315:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658745.097324:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658745.097401:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025319168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658745.097432:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658745.097460:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658745.097472:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025319168 00000100:00100000:0.0:1788658745.097477:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025319168 00000100:00100000:0.0:1788658745.097508:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788658745.097515:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:22719:x1875544025319168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658745.097649:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:22719:x1875544025319168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658745.097657:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788658745.098929:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025319168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658745.098977:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025319296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658745.099032:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658745.099073:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658745.099094:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025319296 00000100:00100000:3.0:1788658745.099107:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025319296 00000100:00100000:3.0:1788658745.099142:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788658745.099149:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:22719:x1875544025319296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658745.099231:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:22719:x1875544025319296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658745.099239:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788658745.099282:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025319296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788658745.100249:0:23933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788658745.100582:0:22719:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788658745.100606:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658745.100630:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658745.100640:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658745.535826:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658745.856379:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788658746.560631:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658746.815189:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025319424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658746.815262:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788658746.815643:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658746.815648:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658746.815650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658746.815652:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658746.815673:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658746.815675:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658746.815678:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658746.815680:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788658746.815826:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025319424 00000100:00100000:2.0:1788658746.815834:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025319424 00000100:00100000:2.0:1788658746.815883:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788658746.815899:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025319424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658746.815933:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788658746.815981:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025319424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658746.816006:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788658746.816036:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025319552:0@lo:400:kworker.0 00000100:00100000:2.0:1788658746.816069:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658746.816096:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658746.816101:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025319680:0@lo:400:kworker.0 00000100:00100000:2.0:1788658746.816124:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658746.816155:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025319808:0@lo:400:kworker.0 00000100:00100000:2.0:1788658746.816178:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658746.816195:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658746.816200:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025319936:0@lo:400:kworker.0 00000100:00100000:2.0:1788658746.816224:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658746.816269:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025319424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658746.816293:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025319808 00000100:00100000:2.0:1788658746.816297:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025319808 00000100:00100000:2.0:1788658746.816315:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788658746.816321:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025319808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658746.816359:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025319808:12345-0@lo:400:kworker.0 Request processed in 38us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658746.816365:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788658746.816382:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025319552 00000100:00100000:2.0:1788658746.816385:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025319552 00000100:00100000:2.0:1788658746.816418:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658746.816425:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:3647:x1875544025319552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658746.816459:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:3647:x1875544025319552:12345-0@lo:400:kworker.0 Request processed in 35us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658746.816476:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658746.816522:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025319680 00000100:00100000:2.0:1788658746.816525:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025319680 00000100:00100000:2.0:1788658746.816551:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025319936 00000100:00100000:2.0:1788658746.816554:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025319936 00000100:00100000:2.0:1788658746.816568:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658746.816574:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025319680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658746.816618:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025319680:12345-0@lo:400:kworker.0 Request processed in 31us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658746.816625:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658746.816638:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658746.816644:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025319936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658746.816671:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025319936:12345-0@lo:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658746.816677:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788658746.816731:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d83798e00 x1875544025319936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658746.816743:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025319936:0@lo:400:kworker.0 00000100:00100000:2.0:1788658746.816754:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025319808:0@lo:400:kworker.0 00010000:00080000:2.0:1788658746.816779:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d83799180 x1875544025319680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658746.816788:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025319680:0@lo:400:kworker.0 00000100:00100000:2.0:1788658746.816797:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025319552:0@lo:400:kworker.0 00000100:00100000:2.0:1788658746.817115:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025320064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658746.817152:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658746.817192:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025320064 00000100:00100000:2.0:1788658746.817196:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025320064 00000100:00100000:2.0:1788658746.817232:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788658746.817238:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025320064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658746.817259:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788658746.817293:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025320064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658746.817299:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788658746.817328:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025320064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658746.818482:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658736/real 1788658736] req@ffff8a1d8379b100 x1875544025313536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658746 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658746.818505:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d8379b100 x1875544025313536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658746 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658746.818516:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658736/real 1788658736] req@ffff8a1d83799c00 x1875544025313280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658746 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658746.818527:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d83799c00 x1875544025313280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658746 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788658746.818542:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdb65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658746.818550:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788658746.818554:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025313536:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788658746.818559:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb740b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658746.818563:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788658746.818566:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025313280:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788658746.819633:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658746.819641:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658746.819644:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658746.819648:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658746.819651:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658746.819655:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788658746.819658:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1eb740b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658746.819665:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 653 00000100:00080000:0.0:1788658746.819671:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788658746.819678:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a1eb740b000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658746.819733:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb1c94380 x1875544025320192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788658746.819758:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658746.819761:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788658746.819769:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdb65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658746.819773:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 653 00000100:00080000:0.0:1788658746.819775:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788658746.819779:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ebdb65800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658746.819862:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb1c96d80 x1875544025320320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658746.820061:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025320192:0@lo:8:kworker.0 00000400:00000100:2.0:1788658746.820116:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025320192 offset 0 length 520: 4 00000100:00100000:2.0:1788658746.820152:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025320320:0@lo:8:kworker.0 00000400:00000100:2.0:1788658746.820174:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025320320 offset 0 length 520: 4 00010000:00010000:0.0:1788658747.584247:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788658747.840359:0:23455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788658748.606911:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658748.673865:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788658748.862899:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658733/real 1788658733] req@ffff8a1d8379b800 x1875544025311360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658748.862930:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d8379b800 x1875544025311360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658748.862941:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658733/real 1788658733] req@ffff8a1d8379ad80 x1875544025311488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658748.862952:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d8379ad80 x1875544025311488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658748.862971:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb2139800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658748.862989:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788658748.862993:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025311360:0@lo:8:kworker.0 00000100:00080000:3.0:1788658748.862998:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e86d86000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658748.863003:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788658748.863012:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025311488:0@lo:8:kworker.0 00000100:00080000:2.0:1788658748.863174:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658748.863179:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788658748.863181:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1eb2139800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658748.863187:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 650 00000100:00080000:2.0:1788658748.863192:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788658748.863198:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1eb2139800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658748.863217:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83c22680 x1875544025320704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658748.863227:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658748.863236:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788658748.863237:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1e86d86000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658748.863241:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 650 00000100:00080000:2.0:1788658748.863243:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788658748.863246:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1e86d86000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658748.863256:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83c23100 x1875544025320832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658748.863275:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658748.863279:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658748.863281:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658748.863284:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788658748.863305:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025321088:0@lo:400:kworker.0 00000100:00100000:2.0:1788658748.863363:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658748.863396:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788658748.863401:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025320448:0@lo:400:kworker.0 00000100:00100000:2.0:1788658748.863424:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658748.863445:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025321216:0@lo:400:kworker.0 00000100:00100000:2.0:1788658748.863464:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658748.863486:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025320576:0@lo:400:kworker.0 00000100:00100000:2.0:1788658748.863504:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658748.863523:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658748.863528:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025320960:0@lo:400:kworker.0 00000100:00100000:2.0:1788658748.863548:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658748.863577:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025321088 00000100:00100000:2.0:1788658748.863591:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025321088 00000100:00100000:2.0:1788658748.863636:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025320576 00000100:00100000:2.0:1788658748.863639:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025320576 00000100:00100000:2.0:1788658748.863654:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788658748.863664:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025321088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658748.863750:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025321088:12345-0@lo:400:kworker.0 Request processed in 88us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658748.863758:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788658748.863773:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658748.863779:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025320576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658748.863812:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025320576:12345-0@lo:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658748.863817:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658748.863834:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025321216 00000100:00100000:2.0:1788658748.863837:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025321216 00000100:00100000:2.0:1788658748.863859:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025320960 00000100:00100000:2.0:1788658748.863862:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025320960 00000100:00100000:2.0:1788658748.863873:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658748.863878:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025321216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658748.863983:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025321216:12345-0@lo:400:kworker.0 Request processed in 104us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658748.863989:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658748.864000:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658748.864005:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025320960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658748.864026:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025320960:12345-0@lo:400:kworker.0 Request processed in 21us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658748.864031:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788658748.864074:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d83c21180 x1875544025320960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658748.864086:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025320960:0@lo:400:kworker.0 00000100:00100000:2.0:1788658748.864095:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025320576:0@lo:400:kworker.0 00010000:00080000:2.0:1788658748.864115:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d83c23b80 x1875544025321216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658748.864124:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025321216:0@lo:400:kworker.0 00000100:00100000:2.0:1788658748.864132:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025321088:0@lo:400:kworker.0 00000100:00100000:3.0:1788658748.864682:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025320448 00000100:00100000:3.0:1788658748.864688:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025320448 00000100:00100000:3.0:1788658748.864734:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788658748.864741:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:3647:x1875544025320448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658748.864785:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:3647:x1875544025320448:12345-0@lo:400:kworker.0 Request processed in 44us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658748.864791:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788658748.864822:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025320704:0@lo:8:kworker.0 00000400:00000100:3.0:1788658748.864847:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025320704 offset 0 length 520: 4 00000100:00100000:3.0:1788658748.864868:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025320832:0@lo:8:kworker.0 00000400:00000100:3.0:1788658748.864886:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025320832 offset 0 length 520: 4 00000100:00100000:3.0:1788658748.864915:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025320448:0@lo:400:kworker.0 00010000:00010000:2.0:1788658749.631025:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788658750.012634:0:24221:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788658750.012639:0:24221:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788658750.012641:0:24221:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788658750.013945:0:24221:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1d83d59800 00000020:01000004:3.0:1788658750.013970:0:24221:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788658750.013991:0:24221:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788658750.014010:0:24221:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a1d821bcd40) 00000020:00000080:3.0:1788658750.014032:0:24221:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788658750.079349:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788658750.084125:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788658750.084373:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788658750.085104:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788658750.085341:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788658750.085589:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788658750.085945:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788658750.089613:0:24221:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788658750.089889:0:24221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788658750.089904:0:24221:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788658750.089917:0:24221:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x48e67cc629c7046f 00000020:01000004:3.0:1788658750.089924:0:24221:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788658750.089949:0:24221:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788658750.089952:0:24221:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788658750.089958:0:24221:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788658750.089963:0:24221:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788658750.089975:0:24221:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a1d821bb380) 00000020:00000080:3.0:1788658750.089986:0:24221:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788658750.092337:0:24221:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658750.092516:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788658750.092524:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788658750.097506:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788658750.097519:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788658750.098183:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788658750.098191:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788658750.099567:0:24221:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658750.099780:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788658750.099785:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788658750.100487:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788658750.100495:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788658750.128156:0:24221:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658750.128413:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788658750.128421:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788658750.130356:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788658750.130370:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788658750.131351:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788658750.131361:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788658750.134246:0:24221:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658750.134448:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788658750.134454:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788658750.135666:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788658750.135676:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788658750.203125:0:24221:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658750.203344:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788658750.203352:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788658750.214354:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788658750.224084:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788658750.224540:0:24221:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788658750.224564:0:24221:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788658750.224569:0:24221:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788658750.255533:0:24221:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788658750.255571:0:24221:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788658750.255575:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788658750.255581:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788658750.255583:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658750.255584:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658750.255585:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658750.255586:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658750.255587:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788658750.255588:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658750.255590:0:24221:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788658750.255602:0:24221:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788658750.255605:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788658750.255606:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788658750.255607:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658750.255608:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658750.255609:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658750.255610:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658750.255611:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788658750.255612:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658750.255613:0:24221:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788658750.255640:0:24221:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788658750.255660:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321344:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788658750.255767:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.255817:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8362a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658750.255920:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025321344 00000100:00100000:2.0:1788658750.255927:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025321344 00000100:00100000:2.0:1788658750.256000:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788658750.256011:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:24221:x1875544025321344:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788658750.256042:0:22715:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788658750.256046:0:22715:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788658750.256050:0:22715:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788658750.256570:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:24221:x1875544025321344:12345-0@lo:253:mount.lustre.0 Request processed in 560us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658750.256579:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788658750.256674:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321344:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788658750.256687:0:24221:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788658750.256689:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658750.256690:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788658750.256691:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658750.256692:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658750.256693:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658750.256694:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658750.256695:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788658750.256697:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658750.256698:0:24221:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788658750.256753:0:24221:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1d83d59800 from lustre-OST0000 10000000:01000000:3.0:1788658750.256792:0:24221:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788658750.256795:0:24221:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788658750.256802:0:24221:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a1eb3974d40 local copy 00010000:00010000:3.0:1788658750.256816:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658750.256931:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658750.256961:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.257226:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e988a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658750.257287:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025321472 00000100:00100000:2.0:1788658750.257299:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025321472 00000100:00100000:2.0:1788658750.257335:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788658750.257344:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:24221:x1875544025321472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658750.257463:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:24221:x1875544025321472:12345-0@lo:501:mount.lustre.0 Request processed in 120us (501us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658750.257469:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788658750.257558:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321472:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788658750.257572:0:24221:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788658750.257606:0:24221:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788658750.257612:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.257622:0:24221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658750.257645:0:24221:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1d83d59800 10000000:01000000:0.0:1788658750.257650:0:24221:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788658750.257655:0:24221:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788658750.257658:0:24221:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658750.257662:0:24221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788658750.257665:0:24221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788658750.257686:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602800/0x48e67cc629c7047d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.257847:0:24221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602800/0x48e67cc629c7047d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.257860:0:24221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602800/0x48e67cc629c7047d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658750.257885:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658750.257917:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658750.257937:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec121bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658750.258100:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025321600 00000100:00100000:2.0:1788658750.258105:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025321600 00000100:00100000:2.0:1788658750.258139:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788658750.258147:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+18:24221:x1875544025321600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658750.258157:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658750.258170:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c70484 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c7047d expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.258191:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c70484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c7047d expref: 19 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.258201:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c70484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c7047d expref: 19 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.258211:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390400, rc 0) 00000100:00100000:2.0:1788658750.258251:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:24221:x1875544025321600:12345-0@lo:101:mount.lustre.0 Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658750.258257:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788658750.258355:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658750.258367:0:24221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602800/0x48e67cc629c7047d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70484 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.258376:0:24221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602800/0x48e67cc629c7047d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70484 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658750.259515:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788658750.260358:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658750.262367:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788658750.262416:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788658750.262432:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788658750.262446:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788658750.262459:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788658750.262474:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788658750.262490:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788658750.262504:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788658750.262518:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1788658750.262534:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1788658750.262571:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1788658750.262587:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1788658750.262625:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1788658750.262631:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1788658750.262760:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658750.262834:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658750.262881:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec121b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658750.263236:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025321728 00000100:00100000:3.0:1788658750.263244:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025321728 00000100:00100000:3.0:1788658750.263286:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788658750.263296:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:24221:x1875544025321728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658750.263461:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:24221:x1875544025321728:12345-0@lo:501:mount.lustre.0 Request processed in 166us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658750.263468:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788658750.263622:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658750.263659:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321856:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658750.263799:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658750.264010:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec121b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658750.265054:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025321856 00000100:00100000:3.0:1788658750.265063:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025321856 00000100:00100000:3.0:1788658750.265112:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788658750.265121:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:24221:x1875544025321856:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658750.265847:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:24221:x1875544025321856:12345-0@lo:503:mount.lustre.0 Request processed in 719us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658750.265855:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788658750.265967:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321856:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788658750.266386:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658750.266453:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658750.266500:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658750.266527:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec121bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658750.267010:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025321984 00000100:00100000:3.0:1788658750.267016:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025321984 00000100:00100000:3.0:1788658750.267044:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788658750.267050:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:24221:x1875544025321984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658750.267446:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:24221:x1875544025321984:12345-0@lo:502:mount.lustre.0 Request processed in 394us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658750.267454:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788658750.267817:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025321984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658750.268198:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788658750.268228:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788658750.268245:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788658750.268259:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788658750.268273:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788658750.268287:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788658750.268300:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788658750.268313:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788658750.268325:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788658750.268338:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788658750.268352:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788658750.268366:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788658750.268395:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658750.268441:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658750.268480:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb23c5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658750.268543:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025322112 00000100:00100000:2.0:1788658750.268548:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025322112 00000100:00100000:2.0:1788658750.268586:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788658750.268603:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:24221:x1875544025322112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658750.268733:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:24221:x1875544025322112:12345-0@lo:502:mount.lustre.0 Request processed in 139us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658750.268740:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788658750.269026:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658750.269070:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788658750.269078:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788658750.269886:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788658750.269894:0:24238:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788658750.269901:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658750.269904:0:24238:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788658750.269910:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658750.269925:0:24238:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a1eb48699c0) 00000020:00000080:1.0:1788658750.269951:0:24238:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788658750.269958:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788658750.270049:0:24238:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d83d59800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788658750.270059:0:24238:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788658750.270068:0:24238:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x48e67cc629c70492 00010000:00010000:1.0:1788658750.274329:0:24238:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788658750.275084:0:24238:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1788658750.276462:0:24238:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788658750.277846:0:24238:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788658750.277858:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658750.277864:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658750.277866:0:24238:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788658750.277869:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788658750.277872:0:24238:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788658750.277874:0:24238:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788658750.277875:0:24238:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788658750.277885:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788658750.277888:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658750.277889:0:24238:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788658750.277892:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658750.277895:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658750.277896:0:24238:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788658750.277899:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788658750.277901:0:24238:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788658750.277903:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658750.277905:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658750.277906:0:24238:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788658750.277909:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658750.277911:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658750.277912:0:24238:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788658750.277915:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788658750.277939:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658750.277942:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658750.277944:0:24238:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788658750.277946:0:24238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788658750.278168:0:24221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788658750.278197:0:24221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788658750.278215:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602800/0x48e67cc629c7047d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70484 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.278227:0:24221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602800/0x48e67cc629c7047d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70484 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658750.278236:0:24221:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1d83d59800 from 1 10000000:01000000:2.0:1788658750.278239:0:24221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658750.278272:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.278281:0:24221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.278292:0:24221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658750.278316:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658750.278384:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658750.278431:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658750.278673:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025322240 00000100:00100000:1.0:1788658750.278681:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025322240 00000100:00100000:1.0:1788658750.278749:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788658750.278759:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:24221:x1875544025322240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658750.278782:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658750.278794:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c704a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70499 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658750.278817:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c704a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70499 expref: 20 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658750.278828:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c704a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70499 expref: 20 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658750.278849:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2400, rc 0) 00000100:00100000:1.0:1788658750.279042:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:24221:x1875544025322240:12345-0@lo:101:mount.lustre.0 Request processed in 283us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658750.279049:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788658750.279130:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658750.279145:0:24221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658750.279156:0:24221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658750.280191:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788658750.280449:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658750.280655:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788658750.280677:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788658750.280696:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788658750.280989:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788658750.281003:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788658750.281013:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788658750.281023:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788658750.281034:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788658750.281047:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788658750.281059:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788658750.281089:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788658750.281110:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788658750.281115:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788658750.281181:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658750.281237:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.281340:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2173b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658750.283618:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025322368 00000100:00100000:2.0:1788658750.283630:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025322368 00000100:00100000:2.0:1788658750.283688:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788658750.283698:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:24221:x1875544025322368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658750.284131:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:24221:x1875544025322368:12345-0@lo:501:mount.lustre.0 Request processed in 433us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658750.284139:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788658750.284235:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658750.284282:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658750.284327:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.284365:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2173b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658750.284419:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025322496 00000100:00100000:0.0:1788658750.284424:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025322496 00000100:00100000:0.0:1788658750.284461:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788658750.284469:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:24221:x1875544025322496:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658750.284559:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:24221:x1875544025322496:12345-0@lo:503:mount.lustre.0 Request processed in 90us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658750.284565:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788658750.284697:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322496:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788658750.285310:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788658750.285381:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658750.285425:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.285457:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb21739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658750.285533:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025322624 00000100:00100000:2.0:1788658750.285538:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025322624 00000100:00100000:2.0:1788658750.285578:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788658750.285587:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:24221:x1875544025322624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658750.285683:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:24221:x1875544025322624:12345-0@lo:502:mount.lustre.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658750.285690:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788658750.285760:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658750.286087:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788658750.286113:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788658750.286129:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788658750.286143:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788658750.286155:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788658750.286167:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788658750.286179:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788658750.286193:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788658750.286207:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788658750.286222:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788658750.286236:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788658750.286258:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658750.286292:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658750.286319:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025322752 00000100:00100000:2.0:1788658750.286323:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025322752 00000100:00100000:2.0:1788658750.286342:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788658750.286349:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:24221:x1875544025322752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658750.286415:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:24221:x1875544025322752:12345-0@lo:502:mount.lustre.0 Request processed in 65us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658750.286422:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788658750.286458:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658750.286473:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658750.286509:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788658750.286516:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788658750.290735:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658750.290751:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658750.290754:0:24242:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788658750.290761:0:24242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1d83d59800 00000020:00000080:0.0:1788658750.290771:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788658750.290780:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658750.290783:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658750.290784:0:24242:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788658750.290787:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658750.290789:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658750.290791:0:24242:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788658750.290794:0:24242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1d83d59800 00000020:00000080:0.0:1788658750.290796:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788658750.292788:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658750.292801:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658750.292803:0:24242:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788658750.292808:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658750.292812:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658750.292813:0:24242:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788658750.292818:0:24242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1d83d59800 00000020:00000080:0.0:1788658750.292821:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788658750.292989:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658750.292994:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658750.292996:0:24242:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788658750.292999:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658750.293002:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658750.293004:0:24242:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788658750.293008:0:24242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1d83d59800 00000020:00000080:0.0:1788658750.293010:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788658750.293050:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658750.293054:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658750.293055:0:24242:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788658750.293059:0:24242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788658750.298350:0:24221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788658750.298392:0:24221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658750.298415:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.298428:0:24221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658750.298490:0:24221:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788658750.298493:0:24221:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1d83d59800 10000000:01000000:2.0:1788658750.298496:0:24221:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1d83d59800 10000000:01000000:2.0:1788658750.298500:0:24221:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658750.298505:0:24221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1d83d59800 from 1 10000000:01000000:2.0:1788658750.298508:0:24221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788658750.298540:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391600/0x48e67cc629c704a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.298548:0:24221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391600/0x48e67cc629c704a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.298558:0:24221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391600/0x48e67cc629c704a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658750.298592:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658750.298682:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658750.298762:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025322880 00000100:00100000:2.0:1788658750.298769:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025322880 00000100:00100000:2.0:1788658750.298813:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788658750.298821:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:24221:x1875544025322880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658750.298834:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658750.298859:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c704ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c704a7 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.298880:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c704ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c704a7 expref: 21 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.298890:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c704ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c704a7 expref: 21 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.298899:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390c00, rc 0) 00000100:00100000:2.0:1788658750.298927:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025322880:12345-0@lo:101:mount.lustre.0 Request processed in 107us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658750.298933:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788658750.298970:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebd8a7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658750.298987:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025322880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658750.298999:0:24221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391600/0x48e67cc629c704a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704ae expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.299007:0:24221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391600/0x48e67cc629c704a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c704ae expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658750.303591:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788658750.304040:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658750.304225:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788658750.304248:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788658750.304261:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788658750.304275:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788658750.304288:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788658750.304301:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788658750.304314:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788658750.304326:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788658750.304339:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788658750.304353:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788658750.304366:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788658750.304378:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788658750.304390:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788658750.304404:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788658750.304418:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788658750.304446:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788658750.304463:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788658750.304475:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788658750.304486:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788658750.304498:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788658750.304509:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788658750.304521:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788658750.304534:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788658750.304548:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788658750.304562:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788658750.304577:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788658750.304590:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788658750.304618:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788658750.304633:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788658750.304658:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788658750.304672:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788658750.304700:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788658750.304743:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788658750.304758:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788658750.304770:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788658750.304782:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788658750.304794:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788658750.304809:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788658750.304821:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788658750.304834:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788658750.304862:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788658750.304875:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788658750.308228:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788658750.308247:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788658750.308262:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788658750.308276:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788658750.308290:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788658750.308327:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788658750.308497:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788658750.308517:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788658750.308535:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788658750.308541:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788658750.308661:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025323008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658750.311023:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658750.311083:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebd8a7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658750.314066:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025323008 00000100:00100000:0.0:1788658750.314083:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025323008 00000100:00100000:0.0:1788658750.314143:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788658750.314153:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025323008:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658750.314329:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025323008:12345-0@lo:501:mount.lustre.0 Request processed in 178us (3311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658750.314337:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788658750.316762:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025323008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658750.316827:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025323136:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658750.316897:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.316943:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2173f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658750.317186:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025323136 00000100:00100000:0.0:1788658750.317193:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025323136 00000100:00100000:0.0:1788658750.317246:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788658750.317256:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025323136:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658750.317367:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025323136:12345-0@lo:503:mount.lustre.0 Request processed in 112us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658750.317374:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788658750.317457:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025323136:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788658750.318101:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788658750.318172:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025323264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658750.318214:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.318234:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2173f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658750.318821:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025323264 00000100:00100000:3.0:1788658750.318827:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025323264 00000100:00100000:0.0:1788658750.319012:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788658750.319022:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025323264:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658750.319129:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025323264:12345-0@lo:502:mount.lustre.0 Request processed in 109us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658750.319136:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788658750.319210:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025323264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658750.319389:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788658750.319417:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788658750.319435:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788658750.319449:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788658750.319461:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788658750.319473:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788658750.319486:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788658750.319499:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788658750.319513:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788658750.319538:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788658750.319552:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788658750.319566:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788658750.319579:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788658750.319604:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788658750.319621:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788658750.319634:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788658750.319647:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788658750.319659:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788658750.319690:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788658750.321009:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788658750.321042:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788658750.321056:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788658750.321070:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788658750.321084:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788658750.321097:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788658750.321110:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788658750.321123:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788658750.321135:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788658750.321147:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788658750.321161:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788658750.321174:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788658750.321187:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788658750.321201:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788658750.321214:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788658750.321238:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788658750.321250:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788658750.321260:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788658750.321270:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788658750.321281:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788658750.321291:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788658750.321302:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788658750.321312:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788658750.321329:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788658750.321340:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788658750.321350:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788658750.321361:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788658750.321371:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788658750.321384:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788658750.321431:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025323392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658750.321496:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.321545:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025323392 00000100:00100000:3.0:1788658750.321551:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025323392 00000100:00100000:3.0:1788658750.321612:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788658750.321621:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025323392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658750.321732:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025323392:12345-0@lo:502:mount.lustre.0 Request processed in 112us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658750.321740:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788658750.321785:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2173f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658750.321802:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025323392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658750.324173:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788658750.324225:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788658750.324267:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025323520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658750.324333:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.324381:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2173f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658750.324734:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025323520 00000100:00100000:0.0:1788658750.324741:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025323520 00000100:00100000:0.0:1788658750.324790:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788658750.324799:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025323520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658750.324931:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025323520:12345-0@lo:502:mount.lustre.0 Request processed in 133us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658750.324939:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788658750.326515:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025323520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658750.327652:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788658750.327672:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788658750.330183:0:24247:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788658750.330201:0:24247:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a1d821b99c0) 00000020:00000080:3.0:1788658750.330233:0:24247:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788658750.330338:0:24247:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d83d59800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788658750.330343:0:24247:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1d83d59800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788658750.330345:0:24247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1d83d59800 3 00010000:00080000:3.0:1788658750.330374:0:24247:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1d822d0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658750.335839:0:24247:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788658750.336081:0:24247:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788658750.336128:0:24247:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788658750.336141:0:24247:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x48e67cc629c704bc 00000100:00080000:3.0:1788658750.336152:0:24247:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658750.336158:0:24247:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a1d822d0800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658750.336194:0:24247:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d81b39500 x1875544025323648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658750.336233:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025323648:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788658750.336299:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788658750.336352:0:24247:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788658750.338079:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025323648 00000100:00100000:2.0:1788658750.338093:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025323648 00000100:00100000:2.0:1788658750.338128:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658750.338136:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875544025323648:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788658750.338163:0:22723:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1788658750.338205:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x48e67cc629c704c3 00000004:00100000:2.0:1788658750.338221:0:22723:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788658750.338254:0:22723:0:(import.c:65:import_set_state_nolock()) ffff8a1e840e9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658750.338332:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875544025323648:12345-0@lo:38:llog_process_th.0 Request processed in 195us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658750.338339:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788658750.338456:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d81b39500 x1875544025323648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658750.338468:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658750.338476:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788658750.338483:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788658750.338488:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788658750.338490:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d822d0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788658750.338496:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025323648:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788658750.339074:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658750.339079:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658750.339082:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658750.339086:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658750.339108:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658750.339111:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658750.339114:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658750.339117:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788658750.341055:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025323776:0@lo:400:kworker.0 00000100:00100000:3.0:1788658750.341125:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.341169:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658750.341176:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025323904:0@lo:400:kworker.0 00000100:00100000:3.0:1788658750.341201:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.341236:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025324032:0@lo:400:kworker.0 00000100:00100000:3.0:1788658750.341259:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.341276:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658750.341283:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025324160:0@lo:400:kworker.0 00000100:00100000:3.0:1788658750.341302:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.341778:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025323904 00000100:00100000:3.0:1788658750.341793:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025323904 00000100:00100000:3.0:1788658750.341833:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025324160 00000100:00100000:3.0:1788658750.341849:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025324160 00000100:00100000:3.0:1788658750.341868:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658750.342001:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025323904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658750.342069:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025323904:12345-0@lo:400:kworker.0 Request processed in 193us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658750.342077:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658750.342093:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658750.342099:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025324160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658750.342130:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025324160:12345-0@lo:400:kworker.0 Request processed in 31us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658750.342136:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658750.342157:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025323776 00000100:00100000:3.0:1788658750.342161:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025323776 00000100:00100000:3.0:1788658750.342175:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025324032 00000100:00100000:3.0:1788658750.342178:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025324032 00000100:00100000:3.0:1788658750.342189:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788658750.342195:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025323776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658750.342228:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025323776:12345-0@lo:400:kworker.0 Request processed in 33us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658750.342234:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788658750.342246:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658750.342251:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025324032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658750.342277:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025324032:12345-0@lo:400:kworker.0 Request processed in 26us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658750.342282:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788658750.342333:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1ebdb98380 x1875544025324160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658750.342347:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025324160:0@lo:400:kworker.0 00000100:00100000:3.0:1788658750.342359:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025324032:0@lo:400:kworker.0 00010000:00080000:3.0:1788658750.342387:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1ebdb98700 x1875544025323904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658750.342397:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025323904:0@lo:400:kworker.0 00000100:00100000:3.0:1788658750.342408:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025323776:0@lo:400:kworker.0 00000020:01000004:3.0:1788658750.344483:0:24247:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788658750.344513:0:24247:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a1d81b119c0) 00000020:00000080:3.0:1788658750.344537:0:24247:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788658750.344628:0:24247:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d83d59800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788658750.344633:0:24247:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1d83d59800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788658750.344636:0:24247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1d83d59800 3 00010000:00080000:3.0:1788658750.344667:0:24247:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1d822d4000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658750.351585:0:24247:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788658750.351906:0:24247:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788658750.351956:0:24247:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788658750.351970:0:24247:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x48e67cc629c704d1 00000100:00080000:3.0:1788658750.351981:0:24247:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658750.351987:0:24247:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a1d822d4000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658750.352022:0:24247:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d81b39500 x1875544025324288/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658750.352046:0:24247:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788658750.355647:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658750.355657:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658750.355667:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658750.355670:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658750.355673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658750.355676:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658750.355679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658750.355681:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788658750.356614:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875544025324288:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788658750.356694:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658750.356795:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025324288 00000100:00100000:2.0:1788658750.356802:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025324288 00000100:00100000:2.0:1788658750.356837:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1788658750.357323:0:24247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788658750.357387:0:24221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788658750.357418:0:24221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788658750.357439:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391600/0x48e67cc629c704a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704ae expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.357457:0:24221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391600/0x48e67cc629c704a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704ae expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788658750.357505:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788658750.357507:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788658750.357508:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658750.357509:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658750.357510:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658750.357512:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658750.357513:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658750.357515:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658750.357516:0:24221:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788658750.357519:0:24221:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788658750.357522:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788658750.357523:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788658750.357524:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658750.357525:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658750.357526:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658750.357527:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658750.357528:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658750.357529:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658750.357530:0:24221:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788658750.357552:0:24221:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788658750.357567:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025324416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788658750.357624:0:24221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658750.357650:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3453c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658750.357668:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025324416 00000100:00100000:0.0:1788658750.357672:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025324416 00000100:00100000:0.0:1788658750.357726:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788658750.357735:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025324416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788658750.357760:0:22717:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788658750.357773:0:22717:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788658750.357973:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875544025324288:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788658750.357998:0:22722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1788658750.358029:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x48e67cc629c704d8 00000004:00100000:2.0:1788658750.358043:0:22722:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788658750.358073:0:22722:0:(import.c:65:import_set_state_nolock()) ffff8a1e840ea000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658750.358122:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875544025324288:12345-0@lo:38:llog_process_th.0 Request processed in 150us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658750.358135:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788658750.358180:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d81b39500 x1875544025324288/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658750.358191:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658750.358199:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788658750.358206:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788658750.358211:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788658750.358213:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d822d4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788658750.358218:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875544025324288:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788658750.368756:0:22717:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788658750.368776:0:22717:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788658750.369110:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:24221:x1875544025324416:12345-0@lo:253:mount.lustre.0 Request processed in 11372us (11481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658750.369123:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 20000000:01000000:3.0:1788658750.369209:0:22738:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788658750.369222:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788658750.369242:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658750.369258:0:22738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c70429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70422 expref: 20 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658750.369267:0:22738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3391000/0x48e67cc629c70437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70430 expref: 20 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658750.369275:0:22738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658750.369313:0:22738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3391000/0x48e67cc629c70437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c70430 expref: 20 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658750.369327:0:22738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb3391000/0x48e67cc629c70437 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c70430 expref: 20 pid: 22715 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658750.369340:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025324544:0@lo:104: 00000100:00100000:3.0:1788658750.369377:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658750.369429:0:22738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c70429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c70422 expref: 20 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658750.369437:0:22738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c70429 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c70422 expref: 20 pid: 22715 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658750.369445:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025324672:0@lo:104: 00000100:00100000:3.0:1788658750.369470:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658750.369492:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2173840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658750.369603:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:24221:1875544025324416:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788658750.369616:0:24221:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788658750.369619:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788658750.369621:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788658750.369623:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658750.369624:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658750.369625:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658750.369626:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658750.369628:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658750.369630:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658750.369631:0:24221:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788658750.369645:0:24221:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788658750.370396:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788658750.370424:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025324544 00000100:00100000:0.0:1788658750.370430:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025324544 00000100:00100000:0.0:1788658750.370458:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025324672 00000100:00100000:0.0:1788658750.370460:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025324672 00000100:00100000:0.0:1788658750.370475:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658750.370483:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+4:22738:x1875544025324544:12345-0@lo:104: 00010000:00010000:0.0:1788658750.370497:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.370560:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658750.370567:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+4:22738:x1875544025324544:12345-0@lo:104: Request processed in 85us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658750.370574:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658750.370589:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658750.370606:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4834850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:22738:x1875544025324672:12345-0@lo:104: 00010000:00010000:0.0:1788658750.370615:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.370650:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788658750.370655:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4834850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:22738:x1875544025324672:12345-0@lo:104: Request processed in 61us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658750.370660:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788658750.370695:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658750.370727:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.370733:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf602a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658750.370738:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.370746:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658750.370752:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658750.370757:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658750.370786:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.370792:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658750.370810:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.370818:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602a00/0x48e67cc629c70430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70437 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.370828:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658750.370832:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.370972:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658750.370976:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.370992:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658750.370999:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658750.371004:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658750.371017:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371023:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658750.371030:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371036:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603200/0x48e67cc629c70422 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371048:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658750.371050:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658750.371052:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658750.371072:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025324800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658750.371103:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658750.371135:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658750.371142:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025324928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658750.371164:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658750.371198:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025324800 00000100:00100000:0.0:1788658750.371202:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025324800 00010000:00010000:0.0:1788658750.371220:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3391000/0x48e67cc629c70437 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c70430 expref: 21 pid: 22715 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658750.371248:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025324928 00000100:00100000:0.0:1788658750.371251:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025324928 00010000:00010000:0.0:1788658750.371262:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c70429 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c70422 expref: 22 pid: 22715 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658750.371273:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658750.371279:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:3649:x1875544025324800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658750.371288:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658750.371293:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3391000/0x48e67cc629c70437 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c70430 expref: 22 pid: 22715 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371303:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3391000/0x48e67cc629c70437 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c70430 expref: 22 pid: 22715 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371317:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658750.371344:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:3649:x1875544025324800:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658750.371352:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658750.371365:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658750.371371:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:3649:x1875544025324928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658750.371377:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658750.371381:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c70429 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c70422 expref: 21 pid: 22715 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371388:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c70429 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c70422 expref: 21 pid: 22715 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371400:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371414:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788658750.371427:0:22709:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004819664s 00010000:00010000:0.0:1788658750.371431:0:22709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371438:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371445:0:22709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371452:0:22709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371457:0:22709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658750.371461:0:22709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371468:0:22709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371477:0:22709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371486:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658750.371509:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:3649:x1875544025324928:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658750.371515:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658750.371570:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025324928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658750.371579:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025324800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658750.371620:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391000/0x48e67cc629c70437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c70430 expref: 20 pid: 22715 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658750.371630:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025324544:0@lo:104: 00010000:00010000:0.0:1788658750.371640:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c70429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c70422 expref: 19 pid: 22715 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658750.371647:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025324672:0@lo:104: 00010000:00010000:0.0:1788658750.371662:0:22738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371670:0:22738:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371676:0:22738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658750.371681:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c704df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658750.372197:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788658750.374558:0:24221:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788658750.377020:0:24221:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788658750.377029:0:24221:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788658750.377063:0:24221:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788658750.377107:0:24221:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788658750.377125:0:24221:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788658750.377144:0:24221:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788658750.378121:0:24221:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658750.378386:0:24221:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788658750.661033:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788658751.193661:0:24301:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658751.194286:0:24301:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788658751.679752:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658751.935357:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658751.935383:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025325056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658751.935455:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658751.935503:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025325056 00000100:00100000:2.0:1788658751.935511:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025325056 00000100:00100000:2.0:1788658751.935557:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658751.935567:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025325056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658751.935616:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788658751.935654:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025325184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658751.935669:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025325056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658751.935676:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788658751.935680:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658751.935690:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025325184 00000100:00100000:2.0:1788658751.935693:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025325184 00000100:00100000:2.0:1788658751.935726:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788658751.935732:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025325184:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658751.935742:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025325056:0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658751.935755:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788658751.935789:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025325184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658751.935795:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788658751.935800:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025325184:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1788658752.257574:0:22719:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788658752.257611:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ebdc0b000 from 13 10000000:01000000:3.0:1788658752.257616:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658752.257671:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.257684:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.257695:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658752.257746:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025325312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658752.262144:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658752.262200:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658752.262242:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025325312 00000100:00100000:3.0:1788658752.262249:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025325312 00000100:00100000:3.0:1788658752.262298:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788658752.262307:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+19:22719:x1875544025325312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658752.262323:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658752.262343:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c704ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c704e6 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.262369:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c704ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c704e6 expref: 20 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.262381:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c704ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c704e6 expref: 20 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.262391:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96000, rc 0) 00000100:00100000:3.0:1788658752.262432:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:22719:x1875544025325312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658752.262453:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788658752.262519:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025325312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658752.262536:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.262544:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658752.262621:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025325440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788658752.262653:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658752.262669:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658752.262682:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025325440 00000100:00100000:3.0:1788658752.262685:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025325440 00000100:00100000:3.0:1788658752.262729:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788658752.262736:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:22719:x1875544025325440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788658752.262749:0:22717:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788658752.262764:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788658752.262767:0:22717:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788658752.262842:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:22719:x1875544025325440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658752.262849:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788658752.262879:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025325440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788658752.262933:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788658752.262940:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.262956:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658752.262977:0:22719:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788658752.262980:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1d810f6800 from 13 10000000:01000000:3.0:1788658752.262982:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658752.263001:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.263010:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.263019:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658752.263031:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025325568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658752.263057:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658752.263072:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658752.263085:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025325568 00000100:00100000:3.0:1788658752.263088:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025325568 00000100:00100000:3.0:1788658752.263113:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788658752.263119:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:22719:x1875544025325568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658752.263126:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658752.263136:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c704fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c704f4 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.263150:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c704fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c704f4 expref: 21 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.263171:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c704fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c704f4 expref: 21 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.263177:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96e00, rc 0) 00000100:00100000:3.0:1788658752.263205:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:22719:x1875544025325568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658752.263211:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788658752.263242:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025325568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658752.263252:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.263261:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658752.263297:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025325696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788658752.263322:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658752.263334:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658752.263345:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025325696 00000100:00100000:3.0:1788658752.263347:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025325696 00000100:00100000:3.0:1788658752.263368:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788658752.263374:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:22719:x1875544025325696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788658752.263385:0:22714:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788658752.263396:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788658752.263399:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788658752.263458:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:22719:x1875544025325696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 84us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658752.263473:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788658752.263503:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025325696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788658752.263535:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788658752.263540:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658752.263548:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658752.709124:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658753.730352:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658754.758467:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788658755.076699:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788658755.525172:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025325824:0@lo:400:kworker.0 00000100:00100000:0.0:1788658755.525261:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658755.527355:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025325824 00000100:00100000:3.0:1788658755.527370:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025325824 00000100:00100000:3.0:1788658755.527669:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788658755.527682:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:3649:x1875544025325824:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788658755.530395:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658755.530416:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658755.530419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658755.530422:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658755.530474:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658755.530477:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658755.530479:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658755.530482:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788658755.530544:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025326080:0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.530627:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658755.530663:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025326592:0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.530696:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658755.530736:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658755.530742:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025326208:0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.530768:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658755.530803:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025326080 00000100:00100000:1.0:1788658755.530811:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025326080 00000100:00100000:1.0:1788658755.530860:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025326592 00000100:00100000:1.0:1788658755.530862:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025326592 00000100:00100000:1.0:1788658755.530890:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658755.530898:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025326080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.530947:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025326080:12345-0@lo:400:kworker.0 Request processed in 50us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658755.530955:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658755.530970:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658755.530984:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025326592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.531010:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025326592:12345-0@lo:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658755.531015:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658755.531034:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025326208 00000100:00100000:1.0:1788658755.531037:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025326208 00000100:00100000:1.0:1788658755.531059:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788658755.531065:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025326208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.531091:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025326208:12345-0@lo:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658755.531247:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788658755.531290:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025326208:0@lo:400:kworker.0 00010000:00080000:1.0:1788658755.531304:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb9ad80 x1875544025326080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658755.531313:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025326080:0@lo:400:kworker.0 00010000:00080000:1.0:1788658755.531321:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb9a680 x1875544025326592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658755.531329:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025326592:0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.531372:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025325952:0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.531398:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658755.531515:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025326464:0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.531541:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658755.531560:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658755.531566:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025326336:0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.534910:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658755.534988:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025326464 00000100:00100000:1.0:1788658755.534997:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025326464 00000100:00100000:1.0:1788658755.535048:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025326336 00000100:00100000:1.0:1788658755.535051:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025326336 00000100:00100000:1.0:1788658755.535068:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658755.535077:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025326464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.535201:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025326464:12345-0@lo:400:kworker.0 Request processed in 125us (3659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658755.535209:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658755.535224:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658755.535230:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025326336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658755.535256:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025326336:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658755.535262:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788658755.535303:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb99500 x1875544025326336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658755.535316:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025326336:0@lo:400:kworker.0 00010000:00080000:1.0:1788658755.535326:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb99180 x1875544025326464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658755.535334:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025326464:0@lo:400:kworker.0 00000100:00100000:3.0:1788658755.536374:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:3649:x1875544025325824:12345-0@lo:400:kworker.0 Request processed in 8689us (11105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658755.536386:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788658755.536533:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658755.536539:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658755.537387:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025325952 00000100:00100000:2.0:1788658755.537400:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025325952 00000100:00100000:2.0:1788658755.537451:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658755.537461:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025325952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658755.537558:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025325952:12345-0@lo:400:kworker.0 Request processed in 99us (6158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658755.537566:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658755.538337:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025325952:0@lo:400:kworker.0 00000100:00100000:0.0:1788658755.542067:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3649:1875544025325824:0@lo:400:kworker.0 00000001:02000400:3.0:1788658755.623138:0:24593:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788658755.775633:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788658756.580942:0:24645:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658756.581348:0:24645:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788658756.800232:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658757.057216:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658757.057242:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025326720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658757.057320:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658757.057371:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025326720 00000100:00100000:3.0:1788658757.057378:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025326720 00000100:00100000:3.0:1788658757.057437:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788658757.057446:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025326720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658757.057481:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788658757.057545:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025326720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658757.057553:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788658757.057614:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025326720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658757.060166:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025326848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658757.060242:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658757.060331:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025326848 00000100:00100000:3.0:1788658757.060341:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025326848 00000100:00100000:3.0:1788658757.060426:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788658757.060436:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025326848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658757.060470:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788658757.060535:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025326848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658757.060542:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658757.062884:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025326848:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788658757.436373:0:24695:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658757.436617:0:24695:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788658757.823238:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658758.846970:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658758.911380:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788658759.870981:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658760.642030:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658760.642037:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658760.642040:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658760.642043:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658760.642057:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658760.642061:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658760.642072:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658760.642076:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788658760.642139:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025327232:0@lo:400:kworker.0 00000100:00100000:0.0:1788658760.642215:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658760.642268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025327744:0@lo:400:kworker.0 00000100:00100000:0.0:1788658760.642292:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658760.642318:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788658760.642325:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025327104:0@lo:400:kworker.0 00000100:00100000:0.0:1788658760.642364:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658760.642390:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025327616:0@lo:400:kworker.0 00000100:00100000:0.0:1788658760.642416:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658760.642449:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025327232 00000100:00100000:0.0:1788658760.642456:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025327232 00000100:00100000:0.0:1788658760.642499:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025327744 00000100:00100000:0.0:1788658760.642502:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025327744 00000100:00100000:0.0:1788658760.642530:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025327616 00000100:00100000:0.0:1788658760.642534:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025327616 00000100:00100000:0.0:1788658760.642552:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658760.642555:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3650:1875544025326976:0@lo:400:kworker.0 00000100:00100000:0.0:1788658760.642573:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025327232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658760.642606:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658760.642638:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025327488:0@lo:400:kworker.0 00000100:00100000:0.0:1788658760.642644:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025327232:12345-0@lo:400:kworker.0 Request processed in 81us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658760.642654:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658760.642668:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658760.642674:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025327488 00000100:00100000:0.0:1788658760.642679:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025327488 00000100:00100000:0.0:1788658760.642696:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658760.642700:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658760.642727:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025327360:0@lo:400:kworker.0 00000100:00100000:0.0:1788658760.642732:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025327744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658760.642757:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658760.642777:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025327744:12345-0@lo:400:kworker.0 Request processed in 74us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658760.642786:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788658760.642793:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658760.642803:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788658760.642805:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658760.642812:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025327616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658760.642820:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025326976 00000100:00100000:3.0:1788658760.642825:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025326976 00000100:00100000:0.0:1788658760.642855:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025327616:12345-0@lo:400:kworker.0 Request processed in 44us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658760.642863:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658760.642873:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788658760.642880:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658760.642884:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:3650:x1875544025326976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658760.642899:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025327488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658760.642944:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:3650:x1875544025326976:12345-0@lo:400:kworker.0 Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658760.642951:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788658760.642981:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025327104 00000100:00100000:3.0:1788658760.642985:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025327104 00000100:00100000:3.0:1788658760.643003:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025327360 00000100:00100000:3.0:1788658760.643006:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025327360 00000100:00100000:3.0:1788658760.643020:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788658760.643026:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025327104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658760.643061:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025327104:12345-0@lo:400:kworker.0 Request processed in 35us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658760.643067:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788658760.643078:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788658760.643083:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025327360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658760.644174:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025327488:12345-0@lo:400:kworker.0 Request processed in 1272us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658760.644187:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788658760.644269:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025327104:0@lo:400:kworker.0 00010000:00080000:0.0:1788658760.644286:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb1c94e00 x1875544025327616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658760.644297:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025327616:0@lo:400:kworker.0 00010000:00080000:0.0:1788658760.644308:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb1c96300 x1875544025327232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658760.644315:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025327232:0@lo:400:kworker.0 00010000:00080000:0.0:1788658760.644325:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb1c94700 x1875544025327744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658760.644332:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025327744:0@lo:400:kworker.0 00000100:00100000:3.0:1788658760.654113:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025327360:12345-0@lo:400:kworker.0 Request processed in 11018us (11345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658760.654139:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788658760.669939:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025327360:0@lo:400:kworker.0 00000100:00100000:3.0:1788658760.670331:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3650:1875544025326976:0@lo:400:kworker.0 00010000:00080000:3.0:1788658760.670350:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb1c97100 x1875544025327488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658760.670362:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025327488:0@lo:400:kworker.0 00010000:00010000:3.0:1788658760.895842:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658761.598851:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658746/real 1788658746] req@ffff8a1eb1c94380 x1875544025320192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658761 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658761.598886:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1eb1c94380 x1875544025320192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658761 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658761.598896:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658746/real 1788658746] req@ffff8a1eb1c96d80 x1875544025320320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658761 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658761.598906:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1eb1c96d80 x1875544025320320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658761 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788658761.598940:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb740b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788658761.598967:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788658761.598971:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025320192:0@lo:8:kworker.0 00000100:00080000:0.0:1788658761.598978:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdb65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788658761.598983:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788658761.598986:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025320320:0@lo:8:kworker.0 00000100:00080000:3.0:1788658761.599246:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658761.599250:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658761.599253:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658761.599256:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658761.599284:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658761.599288:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788658761.599291:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1eb740b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658761.599297:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 664 00000100:00080000:3.0:1788658761.599302:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788658761.599310:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a1eb740b000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658761.599331:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7402d80 x1875544025328384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658761.599344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658761.599347:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788658761.599349:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdb65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658761.599352:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 664 00000100:00080000:3.0:1788658761.599355:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788658761.599358:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ebdb65800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658761.599369:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7401180 x1875544025328512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658761.599413:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025328000:0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.599477:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658761.599517:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025328768:0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.599542:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658761.599574:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788658761.599580:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3650:1875544025327872:0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.599607:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658761.599632:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025328640:0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.599653:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658761.599679:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025328128:0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.599735:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658761.599754:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025328896:0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.599779:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658761.599792:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658761.599796:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025328256:0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.599816:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658761.599862:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025328000 00000100:00100000:3.0:1788658761.599870:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025328000 00000100:00100000:3.0:1788658761.599902:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025328256 00000100:00100000:3.0:1788658761.599905:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025328256 00000100:00100000:3.0:1788658761.599920:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788658761.599928:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025328000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.599982:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025328000:12345-0@lo:400:kworker.0 Request processed in 53us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658761.599989:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788658761.600007:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788658761.600014:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025328256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.600059:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025328256:12345-0@lo:400:kworker.0 Request processed in 45us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658761.600072:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788658761.600090:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025328768 00000100:00100000:3.0:1788658761.600094:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025328768 00000100:00100000:3.0:1788658761.600111:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025328640 00000100:00100000:3.0:1788658761.600114:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025328640 00000100:00100000:3.0:1788658761.600123:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025328128 00000100:00100000:3.0:1788658761.600125:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025328128 00000100:00100000:3.0:1788658761.600137:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025328896 00000100:00100000:3.0:1788658761.600139:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025328896 00000100:00100000:3.0:1788658761.600151:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658761.600157:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025328768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.600188:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025328768:12345-0@lo:400:kworker.0 Request processed in 31us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658761.600196:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658761.600207:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788658761.600213:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025328640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.600240:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025328640:12345-0@lo:400:kworker.0 Request processed in 27us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658761.600246:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788658761.600256:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788658761.600263:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025328128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.600288:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025328128:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658761.600294:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788658761.600305:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658761.600311:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025328896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.600347:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025328896:12345-0@lo:400:kworker.0 Request processed in 36us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658761.600353:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658761.600372:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025327872 00000100:00100000:3.0:1788658761.600375:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025327872 00000100:00100000:3.0:1788658761.600400:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788658761.600407:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:3650:x1875544025327872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.600435:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:3650:x1875544025327872:12345-0@lo:400:kworker.0 Request processed in 29us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658761.600441:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788658761.600496:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025328256:0@lo:400:kworker.0 00010000:00080000:3.0:1788658761.600509:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b39f80 x1875544025328128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658761.600519:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025328128:0@lo:400:kworker.0 00010000:00080000:3.0:1788658761.600529:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb7400a80 x1875544025328896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658761.600538:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025328896:0@lo:400:kworker.0 00000100:00100000:3.0:1788658761.600574:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025328384:0@lo:8:kworker.0 00000100:00100000:3.0:1788658761.600603:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658761.600629:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025328512:0@lo:8:kworker.0 00000100:00100000:3.0:1788658761.600652:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658761.600686:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025328384 00000100:00100000:3.0:1788658761.600690:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025328384 00000100:00100000:3.0:1788658761.600727:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025328512 00000100:00100000:3.0:1788658761.600736:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025328512 00000100:00100000:3.0:1788658761.600749:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658761.600754:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875544025328384:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788658761.600782:0:24225:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1788658761.600808:0:24225:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c70502 00002000:00100000:3.0:1788658761.600823:0:24225:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a1d822d7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788658761.600828:0:24225:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788658761.600831:0:24225:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788658761.601024:0:24225:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788658761.601049:0:24225:0:(import.c:65:import_set_state_nolock()) ffff8a1d822d0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658761.601088:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875544025328384:12345-0@lo:8:kworker.0 Request processed in 332us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658761.601095:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658761.601107:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658761.601112:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875544025328512:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788658761.601124:0:24225:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788658761.605827:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3650:1875544025327872:0@lo:400:kworker.0 00010000:00080000:0.0:1788658761.605862:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb7403b80 x1875544025328640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658761.605875:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025328640:0@lo:400:kworker.0 00000100:00100000:0.0:1788658761.605889:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025328000:0@lo:400:kworker.0 00010000:00080000:0.0:1788658761.605901:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb7401500 x1875544025328768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658761.605910:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025328768:0@lo:400:kworker.0 00010000:00080000:2.0:1788658761.610905:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb7402d80 x1875544025328384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658761.610922:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658761.610934:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788658761.610945:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788658761.610952:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788658761.610955:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb740b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788658761.611019:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788658761.611055:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025328384:0@lo:8:kworker.0 00000004:00080000:1.0:1788658761.614183:0:23463:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788658761.614308:0:23463:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678830604475ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788658761.614334:0:23463:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788658761.617014:0:23455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000004:00080000:0.0:1788658761.622728:0:23464:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788658761.622762:0:23464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23464:1875544025329152:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788658761.622841:0:23464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658761.622874:0:23464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e88e1c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658761.622977:0:24227:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788658761.622986:0:24227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788658761.623010:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658761.623024:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025329024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658761.623056:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658761.623096:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025329024 00000100:00100000:1.0:1788658761.623104:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025329024 00000100:00100000:1.0:1788658761.623156:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658761.623167:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875544025329024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658761.623197:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788658761.623243:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875544025329024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658761.623249:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788658761.623268:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788658761.623295:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb1c96d80 x1875544025329024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658761.623314:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025329024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658761.623545:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025329152 00000100:00100000:0.0:1788658761.623549:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025329152 00000100:00100000:1.0:1788658761.623698:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658761.623739:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23464:x1875544025329152:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788658761.642589:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875544025328512:12345-0@lo:8:kworker.0 Request processed in 41467us (41927us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788658761.642604:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788658761.643022:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdb65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658761.643035:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788658761.643042:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025328512:0@lo:8:kworker.0 00002000:00080000:0.0:1788658761.645013:0:24896:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788658761.645073:0:24896:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788658761.645164:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23464:x1875544025329152:12345-0@lo:7:osp-pre-0-1.0 Request processed in 21423us (22320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658761.645177:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788658761.645280:0:23464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb1c94380 x1875544025329152/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788658777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658761.645295:0:23464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23464:1875544025329152:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788658761.645311:0:23464:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788658761.645351:0:23464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23464:1875544025329280:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788658761.645392:0:23464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658761.645420:0:23464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658761.645459:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025329280 00000100:00100000:0.0:1788658761.645465:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025329280 00000100:00100000:0.0:1788658761.645505:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658761.645514:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23464:x1875544025329280:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788658761.645537:0:24227:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788658761.645576:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23464:x1875544025329280:12345-0@lo:5:osp-pre-0-1.0 Request processed in 63us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658761.645582:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788658761.645642:0:23464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb9bb80 x1875544025329280/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658761.645651:0:23464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23464:1875544025329280:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788658761.645658:0:23464:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788658761.645680:0:23464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23464:1875544025329408:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788658761.645729:0:23464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658761.645749:0:23464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658761.645800:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025329408 00000100:00100000:0.0:1788658761.645804:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025329408 00000100:00100000:0.0:1788658761.646187:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658761.646196:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23464:x1875544025329408:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788658761.646225:0:24225:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:2.0:1788658761.717088:0:24222:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788658761.717113:0:24222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788658761.717350:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23464:x1875544025329408:12345-0@lo:5:osp-pre-0-1.0 Request processed in 71146us (71610us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788658761.717362:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788658761.717450:0:23464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb9bb80 x1875544025329408/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658761.717467:0:23464:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788658761.717476:0:23464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23464:1875544025329408:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788658761.717498:0:23464:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1788658761.717584:0:23464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23464:1875544025329536:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788658761.717646:0:23464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658761.717685:0:23464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e812543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658761.718144:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025329536 00000100:00100000:1.0:1788658761.718156:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025329536 00000100:00100000:1.0:1788658761.718215:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658761.718226:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23464:x1875544025329536:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788658761.718317:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23464:x1875544025329536:12345-0@lo:900:osp-pre-0-1.0 Request processed in 93us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658761.718325:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788658761.718405:0:23464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83c23800 x1875544025329536/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788658777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658761.718422:0:23464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23464:1875544025329536:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1788658761.923813:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658762.175874:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025329664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658762.175947:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658762.175995:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658762.176002:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025329792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658762.176014:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025329664 00000100:00100000:3.0:1788658762.176021:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025329664 00000100:00100000:0.0:1788658762.176025:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658762.176054:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025329792 00000100:00100000:0.0:1788658762.176057:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025329792 00000100:00100000:3.0:1788658762.176064:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788658762.176073:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025329664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658762.176123:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788658762.176173:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025329664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658762.176179:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788658762.176195:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658762.176201:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025329792:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658762.176215:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025329664:0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658762.176216:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788658762.176249:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025329792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658762.176255:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788658762.176258:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025329792:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658762.942892:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658763.971792:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788658764.263372:0:25041:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788658764.263376:0:25041:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788658764.263378:0:25041:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788658764.263589:0:25041:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1d823c0000 00000020:01000004:1.0:1788658764.263607:0:25041:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788658764.263623:0:25041:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788658764.263635:0:25041:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a1eb486cd40) 00000020:00000080:1.0:1788658764.263653:0:25041:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788658764.305677:0:25041:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788658764.309851:0:25041:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788658764.311344:0:25041:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788658764.312220:0:25041:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788658764.312426:0:25041:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788658764.312782:0:25041:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788658764.313019:0:25041:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788658764.314199:0:25041:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788658764.314418:0:25041:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788658764.314433:0:25041:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788658764.314446:0:25041:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x48e67cc629c70510 00000020:01000004:3.0:1788658764.314453:0:25041:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788658764.314475:0:25041:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788658764.314479:0:25041:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788658764.314485:0:25041:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788658764.314656:0:25041:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788658764.314661:0:25041:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788658764.325167:0:25041:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788658764.325234:0:25041:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.153@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788658764.325238:0:25041:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788658764.325245:0:25041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788658764.325246:0:25041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658764.325247:0:25041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658764.325248:0:25041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658764.325250:0:25041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658764.325251:0:25041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788658764.325253:0:25041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658764.325254:0:25041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788658764.325258:0:25041:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788658764.325260:0:25041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788658764.325261:0:25041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788658764.325262:0:25041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658764.325263:0:25041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658764.325264:0:25041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658764.325265:0:25041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658764.325266:0:25041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788658764.325266:0:25041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658764.325267:0:25041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788658764.325294:0:25041:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788658764.325315:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025329920:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788658764.325398:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658764.325449:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3453240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658764.325579:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025329920 00000100:00100000:2.0:1788658764.325587:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025329920 00000100:00100000:2.0:1788658764.325760:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788658764.325772:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:25041:x1875544025329920:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788658764.325811:0:22714:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788658764.325814:0:22714:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788658764.325819:0:22714:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788658764.326091:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:25041:x1875544025329920:12345-0@lo:253:mount.lustre.0 Request processed in 321us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.326098:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788658764.326166:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025329920:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788658764.326179:0:25041:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788658764.326181:0:25041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788658764.326182:0:25041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788658764.326183:0:25041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658764.326183:0:25041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658764.326184:0:25041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658764.326185:0:25041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658764.326186:0:25041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658764.326186:0:25041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658764.326187:0:25041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788658764.326202:0:25041:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1d823c0000 from lustre-OST0001 10000000:01000000:0.0:1788658764.326222:0:25041:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788658764.326224:0:25041:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788658764.326231:0:25041:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a1eb3974d40 local copy 00010000:00010000:0.0:1788658764.326238:0:25041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658764.326311:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658764.326332:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658764.326885:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025330048 00000100:00100000:3.0:1788658764.326891:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025330048 00000100:00100000:3.0:1788658764.326917:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788658764.326922:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:25041:x1875544025330048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658764.326973:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:25041:x1875544025330048:12345-0@lo:501:mount.lustre.0 Request processed in 52us (640us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788658764.326978:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788658764.327079:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824b8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658764.327090:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330048:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788658764.327103:0:25041:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788658764.327117:0:25041:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788658764.327122:0:25041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658764.327129:0:25041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c7022a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70231 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658764.327149:0:25041:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1d823c0000 10000000:01000000:0.0:1788658764.327158:0:25041:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788658764.327162:0:25041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788658764.327164:0:25041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658764.327167:0:25041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788658764.327169:0:25041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788658764.327186:0:25041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603c00/0x48e67cc629c70517 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658764.327192:0:25041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603c00/0x48e67cc629c70517 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658764.327198:0:25041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603c00/0x48e67cc629c70517 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658764.327207:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658764.327225:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658764.327241:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824b8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658764.327278:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025330176 00000100:00100000:3.0:1788658764.327281:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025330176 00000100:00100000:3.0:1788658764.327293:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788658764.327296:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:25041:x1875544025330176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658764.327302:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658764.327316:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c7051e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70517 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.327331:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c7051e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70517 expref: 22 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.327339:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b97200/0x48e67cc629c7051e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70517 expref: 22 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.327345:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97200, rc 0) 00000100:00100000:3.0:1788658764.327472:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:25041:x1875544025330176:12345-0@lo:101:mount.lustre.0 Request processed in 173us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658764.327477:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788658764.327627:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658764.327640:0:25041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603c00/0x48e67cc629c70517 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7051e expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658764.327649:0:25041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603c00/0x48e67cc629c70517 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c7051e expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658764.328411:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788658764.329209:0:25041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658764.331229:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788658764.331282:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788658764.331298:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788658764.331311:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788658764.331336:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788658764.331351:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788658764.331366:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788658764.331382:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788658764.331397:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788658764.331419:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788658764.331425:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788658764.331610:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658764.331683:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658764.331982:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824b8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658764.332030:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025330304 00000100:00100000:2.0:1788658764.332037:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025330304 00000100:00100000:2.0:1788658764.332126:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788658764.332135:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:25041:x1875544025330304:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658764.332333:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:25041:x1875544025330304:12345-0@lo:501:mount.lustre.0 Request processed in 199us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.332342:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788658764.332416:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658764.332452:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658764.332579:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658764.332648:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824b8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658764.332679:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025330432 00000100:00100000:2.0:1788658764.332683:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025330432 00000100:00100000:2.0:1788658764.332819:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788658764.332826:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:25041:x1875544025330432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658764.333508:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:25041:x1875544025330432:12345-0@lo:503:mount.lustre.0 Request processed in 671us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.333517:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788658764.333680:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330432:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788658764.334143:0:25041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658764.334226:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330560:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658764.334278:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658764.334613:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824b8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658764.334717:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025330560 00000100:00100000:3.0:1788658764.334724:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025330560 00000100:00100000:3.0:1788658764.334761:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788658764.334769:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:25041:x1875544025330560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658764.335275:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:25041:x1875544025330560:12345-0@lo:502:mount.lustre.0 Request processed in 503us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658764.335282:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788658764.335359:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658764.335639:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788658764.335666:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788658764.335681:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788658764.335695:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788658764.335745:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788658764.335760:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788658764.335774:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788658764.335797:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788658764.335808:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1788658764.335835:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658764.335997:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658764.336029:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824b8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658764.336077:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025330688 00000100:00100000:3.0:1788658764.336081:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025330688 00000100:00100000:3.0:1788658764.336105:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788658764.336111:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:25041:x1875544025330688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658764.336191:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:25041:x1875544025330688:12345-0@lo:502:mount.lustre.0 Request processed in 80us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658764.336196:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788658764.336322:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658764.336356:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1788658764.336363:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788658764.337121:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788658764.337141:0:25045:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788658764.337148:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658764.337151:0:25045:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788658764.337156:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658764.337168:0:25045:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a1eb23f4d40) 00000020:00000080:2.0:1788658764.337194:0:25045:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788658764.337198:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788658764.337255:0:25045:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d823c0000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788658764.337261:0:25045:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658764.337266:0:25045:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x48e67cc629c7052c 00010000:00010000:2.0:1788658764.343285:0:25045:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788658764.345370:0:25045:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1788658764.351231:0:25045:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788658764.356333:0:25045:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788658764.356345:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658764.356359:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.356362:0:25045:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788658764.356368:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658764.356372:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.356374:0:25045:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788658764.356377:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788658764.356379:0:25045:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788658764.356382:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658764.356384:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.356386:0:25045:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788658764.356389:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658764.356391:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.356392:0:25045:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788658764.356396:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788658764.356429:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658764.356432:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.356434:0:25045:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788658764.356437:0:25045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788658764.356737:0:25041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788658764.356766:0:25041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788658764.356783:0:25041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603c00/0x48e67cc629c70517 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7051e expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658764.356792:0:25041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ebf603c00/0x48e67cc629c70517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7051e expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658764.356804:0:25041:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1d823c0000 from 1 10000000:01000000:2.0:1788658764.356806:0:25041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658764.356883:0:25041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658764.356889:0:25041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658764.356899:0:25041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658764.356921:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658764.356989:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.357025:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025330816 00000100:00100000:2.0:1788658764.357030:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025330816 00000100:00100000:2.0:1788658764.357067:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788658764.357074:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:25041:x1875544025330816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658764.357086:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658764.357101:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c7053a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70533 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658764.357133:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c7053a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70533 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658764.357142:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c7053a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70533 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658764.357149:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390a00, rc 0) 00000100:00100000:2.0:1788658764.357173:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:25041:x1875544025330816:12345-0@lo:101:mount.lustre.0 Request processed in 100us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.357178:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788658764.357208:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658764.357226:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658764.357236:0:25041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658764.357243:0:25041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658764.358310:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788658764.359153:0:25041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658764.359408:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788658764.359434:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788658764.359447:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788658764.359460:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788658764.359474:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788658764.359487:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788658764.359500:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788658764.364204:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788658764.364276:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788658764.364294:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788658764.364311:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788658764.364339:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788658764.364345:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788658764.364466:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658764.364560:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.364657:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658764.365023:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025330944 00000100:00100000:1.0:1788658764.365032:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025330944 00000100:00100000:1.0:1788658764.365129:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788658764.365140:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:25041:x1875544025330944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658764.365280:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:25041:x1875544025330944:12345-0@lo:501:mount.lustre.0 Request processed in 141us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658764.365289:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788658764.365365:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025330944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658764.365403:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658764.365454:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658764.365756:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824b8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658764.366312:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025331072 00000100:00100000:2.0:1788658764.366320:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025331072 00000100:00100000:2.0:1788658764.366358:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788658764.366366:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:25041:x1875544025331072:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658764.366542:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:25041:x1875544025331072:12345-0@lo:503:mount.lustre.0 Request processed in 176us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.366549:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788658764.366831:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331072:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788658764.367359:0:25041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658764.367436:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331200:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658764.367489:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658764.374775:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824b8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658764.374975:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025331200 00000100:00100000:2.0:1788658764.374985:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025331200 00000100:00100000:2.0:1788658764.375081:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788658764.375091:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:25041:x1875544025331200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658764.375307:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:25041:x1875544025331200:12345-0@lo:502:mount.lustre.0 Request processed in 217us (7816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.375315:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788658764.375401:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658764.375668:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788658764.375732:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788658764.375751:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788658764.375765:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788658764.375778:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788658764.375791:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788658764.375804:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788658764.375816:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788658764.375829:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788658764.375933:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788658764.375949:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788658764.375989:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658764.376046:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658764.376072:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658764.376140:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025331328 00000100:00100000:1.0:1788658764.376146:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025331328 00000100:00100000:1.0:1788658764.376191:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788658764.376199:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:25041:x1875544025331328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658764.376296:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:25041:x1875544025331328:12345-0@lo:502:mount.lustre.0 Request processed in 98us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658764.376312:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788658764.377623:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658764.378113:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788658764.378126:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788658764.380185:0:25049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658764.380197:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.380200:0:25049:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788658764.380207:0:25049:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1d823c0000 00000020:00000080:1.0:1788658764.380210:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658764.380218:0:25049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658764.380220:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.380221:0:25049:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788658764.380223:0:25049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658764.380225:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.380227:0:25049:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788658764.380229:0:25049:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1d823c0000 00000020:00000080:1.0:1788658764.380231:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658764.380290:0:25049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658764.380292:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.380293:0:25049:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788658764.380296:0:25049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658764.380298:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.380299:0:25049:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658764.380302:0:25049:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1d823c0000 00000020:00000080:1.0:1788658764.380304:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658764.380318:0:25049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658764.380320:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.380321:0:25049:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658764.380323:0:25049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658764.380325:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.380326:0:25049:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788658764.380329:0:25049:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1d823c0000 00000020:00000080:1.0:1788658764.380331:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658764.380347:0:25049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658764.380350:0:25049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658764.380366:0:25049:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788658764.380370:0:25049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788658764.380778:0:25041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788658764.380806:0:25041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658764.380829:0:25041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.380972:0:25041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658764.381031:0:25041:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788658764.381034:0:25041:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1d823c0000 10000000:01000000:3.0:1788658764.381037:0:25041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1d823c0000 10000000:01000000:3.0:1788658764.381041:0:25041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658764.381047:0:25041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1d823c0000 from 1 10000000:01000000:3.0:1788658764.381050:0:25041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788658764.381094:0:25041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c70541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.381100:0:25041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c70541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.381108:0:25041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c70541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658764.381129:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658764.381190:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658764.381223:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658764.381282:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025331456 00000100:00100000:1.0:1788658764.381288:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025331456 00000100:00100000:1.0:1788658764.381322:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788658764.381328:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:25041:x1875544025331456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658764.381339:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658764.381351:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b2a00/0x48e67cc629c70548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70541 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.381374:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b2a00/0x48e67cc629c70548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70541 expref: 24 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.381385:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b2a00/0x48e67cc629c70548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70541 expref: 24 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.381395:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2a00, rc 0) 00000100:00100000:1.0:1788658764.381435:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025331456:12345-0@lo:101:mount.lustre.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658764.381442:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788658764.381488:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658764.381501:0:25041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c70541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70548 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.381510:0:25041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c70541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70548 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788658764.383355:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788658764.383676:0:25041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658764.384015:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788658764.384039:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788658764.384060:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788658764.384073:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788658764.384085:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788658764.384096:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788658764.384110:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788658764.384122:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788658764.384134:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788658764.384146:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788658764.384157:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788658764.384169:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788658764.384180:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788658764.384190:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788658764.384201:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788658764.384214:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788658764.384239:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788658764.384252:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788658764.384264:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788658764.384275:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788658764.384285:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788658764.384296:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788658764.384308:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788658764.384320:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788658764.384331:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788658764.384342:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788658764.384355:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788658764.384368:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788658764.384378:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788658764.384390:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788658764.384401:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788658764.384414:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788658764.384440:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788658764.384462:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788658764.384477:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788658764.384491:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788658764.384503:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788658764.384516:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788658764.384530:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788658764.384543:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788658764.384621:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788658764.384639:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788658764.384652:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788658764.384666:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788658764.384678:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788658764.384690:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788658764.384791:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788658764.384811:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788658764.384999:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788658764.385019:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788658764.385037:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788658764.385042:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788658764.385131:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658764.385197:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658764.385299:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebc8120c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658764.386904:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025331584 00000100:00100000:3.0:1788658764.386918:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025331584 00000100:00100000:3.0:1788658764.386983:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788658764.386995:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025331584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658764.387354:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025331584:12345-0@lo:501:mount.lustre.0 Request processed in 360us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658764.387362:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788658764.387473:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658764.387585:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658764.387633:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658764.387806:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebc8120c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658764.387928:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025331712 00000100:00100000:3.0:1788658764.387934:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025331712 00000100:00100000:3.0:1788658764.389651:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788658764.389672:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025331712:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658764.389870:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025331712:12345-0@lo:503:mount.lustre.0 Request processed in 205us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658764.389879:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788658764.390049:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331712:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788658764.390517:0:25041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658764.391404:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658764.391474:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658764.391938:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebc812f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658764.392486:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025331840 00000100:00100000:2.0:1788658764.392496:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025331840 00000100:00100000:2.0:1788658764.392617:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788658764.392627:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025331840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658764.393160:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025331840:12345-0@lo:502:mount.lustre.0 Request processed in 533us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.393173:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788658764.393244:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658764.393466:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788658764.393495:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788658764.393508:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788658764.395225:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788658764.395282:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788658764.395295:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788658764.395307:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788658764.395319:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788658764.395332:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788658764.395344:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788658764.395358:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788658764.395372:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788658764.395383:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788658764.395395:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788658764.395406:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788658764.395418:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788658764.395428:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788658764.395440:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788658764.395450:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788658764.395462:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788658764.395476:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788658764.395487:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788658764.395516:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788658764.395534:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788658764.395547:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788658764.395571:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788658764.395583:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788658764.395595:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788658764.395618:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788658764.395630:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788658764.395947:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788658764.395966:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788658764.395979:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788658764.395991:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788658764.396004:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788658764.396017:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788658764.396030:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788658764.396041:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788658764.396068:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788658764.396082:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788658764.396092:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788658764.396103:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788658764.396114:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788658764.396126:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788658764.396137:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788658764.396148:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788658764.396162:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788658764.396174:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788658764.396235:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658764.396320:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.396496:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658764.400784:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025331968 00000100:00100000:3.0:1788658764.400802:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025331968 00000100:00100000:3.0:1788658764.400877:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788658764.400887:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025331968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658764.401053:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025331968:12345-0@lo:502:mount.lustre.0 Request processed in 167us (4731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658764.401061:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788658764.401371:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025331968:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658764.401614:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788658764.402792:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788658764.402923:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025332096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658764.402999:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.403050:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e81254240 going to sleep for 11 seconds 00000100:00100000:3.0:1788658764.403126:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025332096 00000100:00100000:3.0:1788658764.403135:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025332096 00000100:00100000:3.0:1788658764.403191:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788658764.403202:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025332096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658764.403306:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025332096:12345-0@lo:502:mount.lustre.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658764.403313:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788658764.403825:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025332096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658764.403967:0:25041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788658764.403975:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788658764.408267:0:25054:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788658764.408288:0:25054:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a1ebd883380) 00000020:00000080:0.0:1788658764.408315:0:25054:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788658764.408411:0:25054:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d823c0000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788658764.408428:0:25054:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1d823c0000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788658764.408431:0:25054:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1d823c0000 3 00010000:00080000:0.0:1788658764.408471:0:25054:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1e82dbe800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.153@tcp at head 00010000:00010000:0.0:1788658764.410103:0:25054:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788658764.411990:0:25054:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788658764.412048:0:25054:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788658764.412062:0:25054:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x48e67cc629c70556 00000100:00080000:0.0:1788658764.412074:0:25054:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658764.412081:0:25054:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a1e82dbe800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658764.412117:0:25054:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb1c97800 x1875544025332224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658764.412202:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025332224:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788658764.412277:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788658764.412631:0:25054:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1788658764.412950:0:25054:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788658764.412964:0:25054:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a1ebd880000) 00000020:00000080:0.0:1788658764.412983:0:25054:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788658764.413049:0:25054:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d823c0000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788658764.413054:0:25054:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1d823c0000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788658764.413056:0:25054:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1d823c0000 3 00010000:00080000:0.0:1788658764.413084:0:25054:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1e82dbf800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.153@tcp at head 00000100:00100000:3.0:1788658764.415773:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025332224 00000100:00100000:3.0:1788658764.415789:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025332224 00000100:00100000:3.0:1788658764.415838:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658764.415848:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875544025332224:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788658764.415878:0:22722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:3.0:1788658764.415913:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x48e67cc629c70564 00000004:00100000:3.0:1788658764.415930:0:22722:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788658764.415965:0:22722:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1213800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658764.416049:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875544025332224:12345-0@lo:38:llog_process_th.0 Request processed in 201us (3771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658764.416056:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788658764.416099:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb1c97800 x1875544025332224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658764.416119:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788658764.416127:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788658764.416135:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788658764.416140:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788658764.416142:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e82dbe800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788658764.416147:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025332224:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788658764.416781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658764.416788:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658764.416791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658764.416795:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658764.416922:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658764.416927:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788658764.416930:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdb65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658764.416935:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 678 00000100:00080000:2.0:1788658764.416940:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788658764.416945:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ebdb65800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658764.416963:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83c20a80 x1875544025332864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658764.416998:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025332864:0@lo:8:kworker.0 00000100:00100000:2.0:1788658764.417028:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025332480:0@lo:400:kworker.0 00000100:00100000:3.0:1788658764.417048:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.417054:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.417079:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025333120:0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.417098:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.417116:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788658764.417123:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025332352:0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.417144:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.417161:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025332992:0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.417179:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.417212:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025332608:0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.417234:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.417249:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025333248:0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.417267:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.417278:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658764.417283:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025332736:0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.417301:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.417330:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025332480 00000100:00100000:2.0:1788658764.417335:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025332480 00000100:00100000:2.0:1788658764.417364:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025333120 00000100:00100000:0.0:1788658764.417394:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025332864 00000100:00100000:0.0:1788658764.417398:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025332864 00000100:00100000:0.0:1788658764.417426:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025332736 00000100:00100000:0.0:1788658764.417429:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025332736 00000100:00100000:1.0:1788658764.417441:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658764.417448:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875544025332864:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788658764.417503:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875544025332864:12345-0@lo:8:kworker.0 Request processed in 54us (454us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788658764.417510:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788658764.417530:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658764.417561:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658764.417566:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdb65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658764.417570:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788658764.417573:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025332864:0@lo:8:kworker.0 00000100:00100000:0.0:1788658764.417689:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658764.417697:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025332736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658764.417764:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025332736:12345-0@lo:400:kworker.0 Request processed in 68us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658764.417771:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788658764.417796:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83c23b80 x1875544025332736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658764.417817:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025332736:0@lo:400:kworker.0 00010000:00010000:0.0:1788658764.417899:0:25054:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788658764.418070:0:25054:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788658764.418112:0:25054:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788658764.418133:0:25054:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x48e67cc629c7056b 00000100:00080000:0.0:1788658764.418139:0:25054:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658764.418143:0:25054:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a1e82dbf800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658764.418163:0:25054:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb1c97800 x1875544025333376/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788658764.418188:0:25054:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788658764.418210:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658764.418213:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658764.418215:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658764.418218:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788658764.418739:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025333120 00000100:00100000:2.0:1788658764.418789:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025332992 00000100:00100000:2.0:1788658764.418794:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025332992 00000100:00100000:2.0:1788658764.418820:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025333248 00000100:00100000:2.0:1788658764.418823:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025333248 00000100:00100000:2.0:1788658764.418913:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658764.418923:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025332480:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788658764.418952:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658764.418956:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658764.418986:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025332480:12345-0@lo:400:kworker.0 Request processed in 65us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.418993:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658764.419007:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788658764.419013:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025333120:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788658764.419017:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83c23800 x1875544025332480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658764.419030:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025332480:0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.419037:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025333120:12345-0@lo:400:kworker.0 Request processed in 25us (1938us total) trans 0 rc 0/0 00010000:00080000:3.0:1788658764.419041:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83799500 x1875544025333120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658764.419043:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658764.419049:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025333120:0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.419052:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788658764.419057:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025332992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.419098:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025332992:12345-0@lo:400:kworker.0 Request processed in 41us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.419104:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788658764.419116:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788658764.419119:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83c21880 x1875544025332992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658764.419122:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025333248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658764.419128:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025332992:0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.419161:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025333248:12345-0@lo:400:kworker.0 Request processed in 40us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.419168:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658764.419188:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025332352 00000100:00100000:2.0:1788658764.419191:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025332352 00000100:00100000:2.0:1788658764.419204:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025332608 00000100:00100000:2.0:1788658764.419205:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025332608 00000100:00100000:2.0:1788658764.419212:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658764.419215:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025332352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.419246:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025332352:12345-0@lo:400:kworker.0 Request processed in 29us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.419252:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658764.419263:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658764.419268:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025332608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658764.419271:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025332352:0@lo:400:kworker.0 00000100:00100000:2.0:1788658764.419294:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025332608:12345-0@lo:400:kworker.0 Request processed in 26us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.419299:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788658764.419916:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875544025333376:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658764.419962:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658764.420007:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025333376 00000100:00100000:1.0:1788658764.420011:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025333376 00000100:00100000:1.0:1788658764.420034:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658764.420039:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875544025333376:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788658764.420064:0:22723:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:1.0:1788658764.420096:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x48e67cc629c70572 00000004:00100000:1.0:1788658764.420111:0:22723:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788658764.420139:0:22723:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdb63000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658764.420176:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875544025333376:12345-0@lo:38:llog_process_th.0 Request processed in 136us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658764.420183:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788658764.420212:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb1c97800 x1875544025333376/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658764.420225:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658764.420231:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788658764.420238:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788658764.420242:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788658764.420244:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e82dbf800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788658764.420251:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875544025333376:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788658764.420495:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025332608:0@lo:400:kworker.0 00010000:00080000:0.0:1788658764.420508:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d8379ad80 x1875544025333248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658764.420518:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025333248:0@lo:400:kworker.0 00000040:00080000:0.0:1788658764.420655:0:25054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788658764.421942:0:25041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788658764.421982:0:25041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788658764.422001:0:25041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c70541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70548 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658764.422025:0:25041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c70541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70548 expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788658764.422080:0:25041:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788658764.422081:0:25041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658764.422082:0:25041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658764.422083:0:25041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658764.422084:0:25041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658764.422085:0:25041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658764.422086:0:25041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658764.422087:0:25041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658764.422088:0:25041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658764.422092:0:25041:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788658764.422093:0:25041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658764.422094:0:25041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658764.422095:0:25041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658764.422095:0:25041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658764.422096:0:25041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658764.422097:0:25041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658764.422097:0:25041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658764.422098:0:25041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658764.422099:0:25041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658764.422118:0:25041:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788658764.422133:0:25041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025333504:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788658764.422178:0:25041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658764.422214:0:25041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e81254240 going to sleep for 11 seconds 00000100:00100000:3.0:1788658764.422216:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025333504 00000100:00100000:3.0:1788658764.422222:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025333504 00000100:00100000:3.0:1788658764.422311:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788658764.422321:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025333504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788658764.422364:0:22715:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788658764.422378:0:22715:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788658764.431147:0:22715:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788658764.431164:0:22715:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788658764.431435:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:25041:x1875544025333504:12345-0@lo:253:mount.lustre.0 Request processed in 9111us (9250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658764.431447:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 20000000:01000000:3.0:1788658764.431468:0:22738:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788658764.431474:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788658764.431498:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.431515:0:22738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c704ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c704e6 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.431523:0:22738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c704fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c704f4 expref: 23 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.431532:0:22738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658764.431536:0:25041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:25041:1875544025333504:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788658764.431568:0:25041:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788658764.431571:0:25041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658764.431573:0:25041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658764.431575:0:25041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658764.431576:0:25041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:3.0:1788658764.431577:0:22738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c704fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c704f4 expref: 23 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788658764.431577:0:25041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658764.431579:0:25041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658764.431581:0:25041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658764.431582:0:25041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658764.431584:0:25041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1788658764.431592:0:22738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c704fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c704f4 expref: 23 pid: 22715 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1788658764.431599:0:25041:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788658764.431605:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025333632:0@lo:104: 00000100:00100000:3.0:1788658764.431642:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658764.431684:0:22738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c704ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c704e6 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.431693:0:22738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c704ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c704e6 expref: 23 pid: 22714 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658764.431726:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025333760:0@lo:104: 00000100:00100000:3.0:1788658764.431754:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658764.431771:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658764.431973:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025333632 00000100:00100000:3.0:1788658764.431979:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025333632 00000100:00100000:3.0:1788658764.432005:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025333760 00000100:00100000:3.0:1788658764.432007:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025333760 00000100:00100000:3.0:1788658764.432019:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658764.432026:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+4:22738:x1875544025333632:12345-0@lo:104: 00010000:00010000:3.0:1788658764.432039:0:22705:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432084:0:22705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788658764.432089:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+4:22738:x1875544025333632:12345-0@lo:104: Request processed in 64us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658764.432096:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658764.432107:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658764.432113:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:22738:x1875544025333760:12345-0@lo:104: 00010000:00010000:3.0:1788658764.432121:0:22705:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432149:0:22705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788658764.432154:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:22738:x1875544025333760:12345-0@lo:104: Request processed in 41us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658764.432161:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788658764.432175:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658764.432181:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432188:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97e00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658764.432198:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432207:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658764.432214:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658764.432220:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658764.432246:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432255:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658764.432280:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432287:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c704f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c704fb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432297:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658764.432300:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432305:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97600 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658764.432307:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432314:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658764.432329:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658764.432335:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658764.432348:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432353:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658764.432368:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432374:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c704e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c704ed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658764.432386:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658764.432387:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658764.432389:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658764.432413:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025333632:0@lo:104: 00000100:00100000:3.0:1788658764.432421:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22738:1875544025333760:0@lo:104: 00010000:00010000:3.0:1788658764.432437:0:22738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658764.432466:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658764.432476:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025334016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658764.432501:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658764.432580:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658764.432598:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025334016 00000100:00100000:1.0:1788658764.432602:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025334016 00000100:00100000:2.0:1788658764.432611:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3650:1875544025333888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658764.432620:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c704ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c704e6 expref: 24 pid: 22714 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658764.432636:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658764.432649:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658764.432657:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:3648:x1875544025334016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658764.432668:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658764.432673:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c704ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c704e6 expref: 24 pid: 22714 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.432682:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c704ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c704e6 expref: 24 pid: 22714 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.432694:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c704ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c704e6 expref: 24 pid: 22714 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.432726:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658764.432757:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:3648:x1875544025334016:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658764.432771:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658764.432794:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025334016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658764.433160:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025333888 00000100:00100000:1.0:1788658764.433164:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025333888 00010000:00010000:1.0:1788658764.433179:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c704fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c704f4 expref: 23 pid: 22715 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658764.433197:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658764.433203:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:3650:x1875544025333888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658764.433211:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658764.433215:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c704fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c704f4 expref: 23 pid: 22715 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433224:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c704fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c704f4 expref: 23 pid: 22715 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433233:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c704fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c704f4 expref: 23 pid: 22715 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433243:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433250:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788658764.433264:0:22709:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004819664s 00010000:00010000:1.0:1788658764.433269:0:22709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433285:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433292:0:22709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433297:0:22709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433302:0:22709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658764.433306:0:22709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433314:0:22709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433327:0:22709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433337:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658764.433381:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:3650:x1875544025333888:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658764.433387:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658764.433422:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3650:1875544025333888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658764.433442:0:22738:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433898:0:22738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658764.433916:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec2045a00/0x48e67cc629c70579 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788658764.438238:0:25041:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788658764.443312:0:25041:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788658764.443323:0:25041:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788658764.443618:0:25041:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788658764.443667:0:25041:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788658764.443683:0:25041:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788658764.444100:0:25041:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788658764.444896:0:25041:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658764.445112:0:25041:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788658764.994748:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788658765.240097:0:25107:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658765.240834:0:25107:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788658765.313034:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788658765.502829:0:22719:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788658765.502837:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ebdc0b000 from 14 10000000:01000000:3.0:1788658765.502862:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658765.502905:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c70580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658765.502915:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c70580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658765.502924:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c70580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658765.502945:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025334144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658765.503005:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658765.503050:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658765.503126:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025334144 00000100:00100000:2.0:1788658765.503132:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025334144 00000100:00100000:2.0:1788658765.503173:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788658765.503180:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:22719:x1875544025334144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658765.503191:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658765.503202:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c70587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70580 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658765.503219:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c70587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70580 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658765.503227:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391800/0x48e67cc629c70587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70580 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658765.503236:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391800, rc 0) 00000100:00100000:2.0:1788658765.503285:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:22719:x1875544025334144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658765.503301:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788658765.503378:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025334144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658765.503394:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c70580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70587 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658765.503403:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c70580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70587 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658765.503441:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025334272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788658765.503464:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658765.503482:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658765.503522:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025334272 00000100:00100000:2.0:1788658765.503526:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025334272 00000100:00100000:2.0:1788658765.503550:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788658765.503555:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:22719:x1875544025334272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788658765.503565:0:22715:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788658765.503578:0:22715:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788658765.503580:0:22715:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788658765.503679:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:22719:x1875544025334272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658765.503686:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788658765.503985:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025334272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788658765.504065:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788658765.504073:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c70580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70587 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658765.504081:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c70580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70587 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658765.504091:0:22719:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788658765.504093:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1d810f6800 from 14 10000000:01000000:0.0:1788658765.504099:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788658765.504119:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602e00/0x48e67cc629c7058e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658765.504125:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602e00/0x48e67cc629c7058e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658765.504133:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602e00/0x48e67cc629c7058e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658765.504146:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025334400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658765.504175:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658765.504247:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead888300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658765.504283:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025334400 00000100:00100000:2.0:1788658765.504288:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025334400 00000100:00100000:2.0:1788658765.504357:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788658765.504365:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:22719:x1875544025334400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658765.504374:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658765.504384:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c70595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c7058e expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658765.504402:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c70595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c7058e expref: 24 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658765.504411:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c70595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c7058e expref: 24 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658765.504417:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390000, rc 0) 00000100:00100000:2.0:1788658765.504455:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:22719:x1875544025334400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658765.504471:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788658765.504525:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025334400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658765.504537:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602e00/0x48e67cc629c7058e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70595 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658765.504544:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602e00/0x48e67cc629c7058e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70595 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658765.504605:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025334528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788658765.504636:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658765.504812:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead888300 going to sleep for 11 seconds 00000100:00100000:3.0:1788658765.504841:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025334528 00000100:00100000:3.0:1788658765.504846:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025334528 00000100:00100000:3.0:1788658765.504871:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788658765.504878:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:22719:x1875544025334528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788658765.504891:0:22714:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788658765.504908:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788658765.504911:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788658765.505134:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:22719:x1875544025334528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 255us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658765.505141:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788658765.505237:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025334528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788658765.505286:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788658765.505292:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602e00/0x48e67cc629c7058e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70595 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658765.505300:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602e00/0x48e67cc629c7058e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70595 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658766.015079:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658766.787003:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658766.787028:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025334656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658766.787113:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658766.787209:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025334656 00000100:00100000:1.0:1788658766.787217:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025334656 00000100:00100000:1.0:1788658766.787275:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658766.787284:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025334656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658766.787317:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788658766.787363:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025334656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658766.787369:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788658766.787559:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788658766.787591:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8379ad80 x1875544025334656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658766.787610:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025334656:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788658767.038944:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658767.296991:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658767.297018:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025334784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658767.297088:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658767.297136:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025334784 00000100:00100000:1.0:1788658767.297144:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025334784 00000100:00100000:1.0:1788658767.297193:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788658767.297202:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025334784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788658767.297235:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788658767.297295:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025334784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658767.297301:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788658767.297350:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025334784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658767.301166:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025334912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658767.301242:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658767.301431:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025334912 00000100:00100000:3.0:1788658767.301442:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025334912 00000100:00100000:3.0:1788658767.301498:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788658767.301508:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025334912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658767.301544:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788658767.301597:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025334912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658767.301604:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788658767.301697:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025334912:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658768.064101:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788658768.136164:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788658768.512147:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658748/real 1788658748] req@ffff8a1d83c22680 x1875544025320704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658768 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658768.512182:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d83c22680 x1875544025320704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658768 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658768.512193:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658748/real 1788658748] req@ffff8a1d83c23100 x1875544025320832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658768 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658768.512205:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d83c23100 x1875544025320832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658768 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658768.512226:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb2139800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658768.512250:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788658768.512254:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025320704:0@lo:8:kworker.0 00000100:00080000:2.0:1788658768.512261:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e86d86000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658768.512266:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788658768.512269:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025320832:0@lo:8:kworker.0 00000100:00080000:1.0:1788658768.512457:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658768.512462:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788658768.512465:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1eb2139800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658768.512470:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:1.0:1788658768.512476:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788658768.512483:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1eb2139800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658768.513543:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83c23b80 x1875544025335296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658768.513564:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658768.513568:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788658768.513570:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1e86d86000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658768.513573:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:1.0:1788658768.513576:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788658768.513581:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1e86d86000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658768.513590:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83c20a80 x1875544025335424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658768.513633:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658768.513642:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788658768.513644:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdb65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658768.513648:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ebdb65800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658768.513659:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83d53480 x1875544025335936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658768.513755:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025335168:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.513823:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658768.513868:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025336064:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.513892:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658768.513908:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025336576:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.513926:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658768.513947:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788658768.513954:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025335040:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.513981:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658768.514002:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025335808:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514025:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658768.514043:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025336448:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514066:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658768.514089:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025335552:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514113:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658768.514136:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025336192:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514156:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658768.514169:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788658768.514175:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025335680:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514205:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658768.514222:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025336320:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514239:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658768.514264:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025335168 00000100:00100000:1.0:1788658768.514270:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025335168 00000100:00100000:1.0:1788658768.514302:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025335680 00000100:00100000:1.0:1788658768.514305:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025335680 00000100:00100000:1.0:1788658768.514318:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658768.514326:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025335168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514375:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025335168:12345-0@lo:400:kworker.0 Request processed in 49us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.514383:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658768.514401:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788658768.514423:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025335680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514457:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025335680:12345-0@lo:400:kworker.0 Request processed in 50us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.514463:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788658768.514481:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025336064 00000100:00100000:1.0:1788658768.514485:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025336064 00000100:00100000:1.0:1788658768.514503:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025336576 00000100:00100000:1.0:1788658768.514505:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025336576 00000100:00100000:1.0:1788658768.514527:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025336448 00000100:00100000:1.0:1788658768.514530:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025336448 00000100:00100000:1.0:1788658768.514541:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025335552 00000100:00100000:1.0:1788658768.514544:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025335552 00000100:00100000:1.0:1788658768.514554:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025336192 00000100:00100000:1.0:1788658768.514556:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025336192 00000100:00100000:1.0:1788658768.514567:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025336320 00000100:00100000:1.0:1788658768.514569:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025336320 00000100:00100000:1.0:1788658768.514595:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658768.514601:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025336064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514634:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025336064:12345-0@lo:400:kworker.0 Request processed in 33us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.514640:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658768.514651:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658768.514658:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025336576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514684:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025336576:12345-0@lo:400:kworker.0 Request processed in 27us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.514690:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658768.514722:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788658768.514729:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025336448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514754:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025336448:12345-0@lo:400:kworker.0 Request processed in 26us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.514760:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788658768.514771:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788658768.514777:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025335552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514802:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025335552:12345-0@lo:400:kworker.0 Request processed in 25us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.514808:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788658768.514818:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658768.514824:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025336192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514849:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025336192:12345-0@lo:400:kworker.0 Request processed in 25us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.514854:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658768.514872:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658768.514877:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025336320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514900:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025336320:12345-0@lo:400:kworker.0 Request processed in 23us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.514905:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658768.514921:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025335040 00000100:00100000:1.0:1788658768.514924:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025335040 00000100:00100000:1.0:1788658768.514948:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788658768.514953:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:3648:x1875544025335040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.514977:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:3648:x1875544025335040:12345-0@lo:400:kworker.0 Request processed in 25us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.514982:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788658768.515006:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025335808 00000100:00100000:1.0:1788658768.515009:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025335808 00000100:00100000:1.0:1788658768.515037:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658768.515043:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025335808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.515071:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025335808:12345-0@lo:400:kworker.0 Request processed in 28us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.515077:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658768.515137:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025335680:0@lo:400:kworker.0 00010000:00080000:1.0:1788658768.515151:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d50000 x1875544025336320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658768.515160:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025336320:0@lo:400:kworker.0 00010000:00080000:1.0:1788658768.515169:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c23100 x1875544025335552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658768.515188:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025335552:0@lo:400:kworker.0 00010000:00080000:1.0:1788658768.515198:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d52300 x1875544025336192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658768.515205:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025336192:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.515237:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025335040:0@lo:400:kworker.0 00010000:00080000:1.0:1788658768.515245:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d53800 x1875544025335808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658768.515252:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025335808:0@lo:400:kworker.0 00010000:00080000:1.0:1788658768.515261:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d52a00 x1875544025336448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658768.515268:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025336448:0@lo:400:kworker.0 00000100:00100000:1.0:1788658768.515277:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025335168:0@lo:400:kworker.0 00010000:00080000:1.0:1788658768.515286:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d52d80 x1875544025336064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658768.515293:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025336064:0@lo:400:kworker.0 00010000:00080000:1.0:1788658768.515301:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d50380 x1875544025336576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658768.515307:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025336576:0@lo:400:kworker.0 00000100:00080000:2.0:1788658768.517932:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658768.517942:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658768.517945:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658768.517964:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025335296:0@lo:8:kworker.0 00000100:00100000:2.0:1788658768.518044:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658768.518104:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025335424:0@lo:8:kworker.0 00000100:00100000:2.0:1788658768.518139:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658768.518162:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025335936:0@lo:8:kworker.0 00000100:00100000:2.0:1788658768.518185:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658768.518225:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025335296 00000100:00100000:2.0:1788658768.518233:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025335296 00000100:00100000:2.0:1788658768.518263:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025335424 00000100:00100000:2.0:1788658768.518267:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025335424 00000100:00100000:2.0:1788658768.518276:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025335936 00000100:00100000:2.0:1788658768.518278:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025335936 00000100:00100000:2.0:1788658768.518290:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658768.518297:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875544025335296:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788658768.518327:0:24896:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:2.0:1788658768.518356:0:24896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c7059c 00002000:00100000:2.0:1788658768.518369:0:24896:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a1d8219a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788658768.518373:0:24896:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788658768.518376:0:24896:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788658768.518617:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658768.518624:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875544025335424:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788658768.518641:0:24225:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:0.0:1788658768.518659:0:24225:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c705a3 00002000:00100000:0.0:1788658768.518666:0:24225:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a1d84c4a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788658768.518670:0:24225:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788658768.518672:0:24225:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788658768.518969:0:24225:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788658768.519002:0:24225:0:(import.c:65:import_set_state_nolock()) ffff8a1d84c49800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658768.519075:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875544025335424:12345-0@lo:8:kworker.0 Request processed in 449us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658768.519082:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658768.519112:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658768.519117:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875544025335936:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788658768.519144:0:24225:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:0.0:1788658768.519160:0:24225:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c705aa 00002000:00100000:0.0:1788658768.519166:0:24225:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a1d84c4c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788658768.519170:0:24225:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788658768.519172:0:24225:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788658768.519196:0:24225:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788658768.519208:0:24225:0:(import.c:65:import_set_state_nolock()) ffff8a1d84c4e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658768.519237:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875544025335936:12345-0@lo:8:kworker.0 Request processed in 119us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658768.519244:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788658768.519287:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c20a80 x1875544025335424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658768.519297:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788658768.519305:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788658768.519312:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788658768.519317:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788658768.519319:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e86d86000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788658768.519334:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788658768.519339:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025335424:0@lo:8:kworker.0 00010000:00080000:0.0:1788658768.519355:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d53480 x1875544025335936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788658768.519365:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788658768.519369:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788658768.519372:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788658768.519380:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdb65800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788658768.519396:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788658768.519400:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025335936:0@lo:8:kworker.0 00000004:00080000:0.0:1788658768.519472:0:22749:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788658768.519617:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22749:1875544025336832:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788658768.519650:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658768.519668:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead888180 going to sleep for 11 seconds 00000004:00080000:0.0:1788658768.519684:0:22748:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788658768.519771:0:22748:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 685736067661ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788658768.519778:0:22748:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788658768.519814:0:23466:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788658768.519829:0:23466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23466:1875544025337088:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788658768.519854:0:23466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658768.519864:0:23466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82a89000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658768.519878:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025336960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658768.519903:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658768.519925:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658768.519930:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025336704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658768.519965:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658768.519992:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025336832 00000100:00100000:0.0:1788658768.519997:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025336832 00000100:00100000:0.0:1788658768.520029:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025337088 00000100:00100000:0.0:1788658768.520032:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025337088 00000100:00100000:0.0:1788658768.520046:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788658768.520053:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22749:x1875544025336832:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788658768.521164:0:24896:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788658768.521194:0:24896:0:(import.c:65:import_set_state_nolock()) ffff8a1d8219d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658768.521265:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1875544025335296:12345-0@lo:8:kworker.0 Request processed in 2966us (3219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658768.521273:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658768.521308:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658768.521318:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23466:x1875544025337088:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788658768.521368:0:23465:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788658768.521423:0:23465:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 685737719495ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788658768.521429:0:23465:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788658768.522770:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025336960 00000100:00100000:0.0:1788658768.522784:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025336960 00000100:00100000:0.0:1788658768.522826:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025336704 00000100:00100000:0.0:1788658768.522829:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025336704 00000100:00100000:0.0:1788658768.522845:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658768.522854:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875544025336960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658768.522880:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788658768.522948:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875544025336960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (3043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658768.522955:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658768.522971:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658768.522978:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875544025336704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658768.522987:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788658768.523012:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875544025336704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (3047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658768.523018:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:2.0:1788658768.524044:0:23455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00080000:1.0:1788658768.524588:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788658768.524661:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c23b80 x1875544025335296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658768.524683:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658768.524694:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788658768.524723:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788658768.524730:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788658768.524734:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb2139800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788658768.524753:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788658768.525138:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025335296:0@lo:8:kworker.0 00010000:00080000:0.0:1788658768.525592:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb1c96300 x1875544025336704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658768.525614:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025336704:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788658768.525631:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb1c97100 x1875544025336960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658768.525643:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025336960:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1788658768.525934:0:22747:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:3.0:1788658768.525960:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22747:1875544025337344:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788658768.526385:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658768.526422:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e868f3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658768.526441:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025337216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658768.526469:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658768.526581:0:24228:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788658768.526590:0:24228:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788658768.526614:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025337216 00000100:00100000:3.0:1788658768.526620:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025337216 00000100:00100000:3.0:1788658768.526663:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658768.526671:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025337216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658768.526691:0:24230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000004:00080000:2.0:1788658768.526894:0:22746:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788658768.526980:0:22746:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 685743276032ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788658768.526987:0:22746:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788658768.527381:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025337216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658768.527392:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788658768.527436:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb7403b80 x1875544025337216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658768.527455:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025337216:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788658768.527476:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788658768.529233:0:24225:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788658768.529243:0:24225:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1788658768.529249:0:24225:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00000100:00100000:0.0:1788658768.529645:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025337344 00000100:00100000:0.0:1788658768.529653:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025337344 00000100:00100000:2.0:1788658768.529870:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658768.529881:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22747:x1875544025337344:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788658768.532672:0:22702:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788658768.540587:0:24227:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788658768.540603:0:24227:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788658768.540611:0:24227:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00080000:0.0:1788658768.542996:0:24896:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788658768.543008:0:24896:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788658768.543236:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23466:x1875544025337088:12345-0@lo:7:osp-pre-1-1.0 Request processed in 21915us (23376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658768.543259:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788658768.545116:0:23466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb1c95180 x1875544025337088/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788658784 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658768.545155:0:23466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23466:1875544025337088:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788658768.545183:0:23466:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788658768.545266:0:23466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23466:1875544025337472:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788658768.545357:0:23466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658768.547368:0:23466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e868f3c00 going to sleep for 11 seconds 00000004:00080000:1.0:1788658768.548813:0:22702:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788658768.550243:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025337472 00000100:00100000:0.0:1788658768.550258:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025337472 00000100:00100000:0.0:1788658768.550325:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658768.550337:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23466:x1875544025337472:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788658768.550371:0:24228:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00002000:00010000:1.0:1788658768.550600:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658768.550613:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0bea886/0x48e67cc629c705b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.550631:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.550636:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658768.550645:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0bea886/0x48e67cc629c705b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.550666:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0bea886/0x48e67cc629c705b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.550677:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0bea886/0x48e67cc629c705b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658768.550904:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23466:x1875544025337472:12345-0@lo:5:osp-pre-1-1.0 Request processed in 569us (5545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658768.550912:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788658768.550969:0:23466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb7403b80 x1875544025337472/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658784 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658768.550983:0:23466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23466:1875544025337472:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788658768.551000:0:23466:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00010000:00010000:1.0:1788658768.551207:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0bea886/0x48e67cc629c705b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.551299:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788658768.551588:0:23466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d823a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23466:1875544025337600:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788658768.551637:0:23466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658768.551662:0:23466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec121b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658768.551679:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025337600 00000100:00100000:0.0:1788658768.551684:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025337600 00000100:00100000:0.0:1788658768.551744:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788658768.551752:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23466:x1875544025337600:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788658768.551866:0:24896:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:0.0:1788658768.557819:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658768.557835:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0bea886/0x48e67cc629c705b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.557877:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658768.557883:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0bea886/0x48e67cc629c705b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.557896:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0bea886/0x48e67cc629c705b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.557925:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0bea886/0x48e67cc629c705b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.557934:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0bea886/0x48e67cc629c705b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.557967:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658768.557970:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658768.557972:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658768.564259:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658768.564272:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c705b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.564290:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.564295:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658768.564301:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c705b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.564891:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c705b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.564906:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c705b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.564976:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c705b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.565474:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.566664:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.566683:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c705b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.566699:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.566733:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c705b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.566748:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c705b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.566785:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c705b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.566815:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c705b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.566858:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.566862:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.566866:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658768.567449:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.567461:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014a8fbb4/0x48e67cc629c705bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.567478:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.567483:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.567490:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014a8fbb4/0x48e67cc629c705bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.567722:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014a8fbb4/0x48e67cc629c705bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.567736:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014a8fbb4/0x48e67cc629c705bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.567751:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014a8fbb4/0x48e67cc629c705bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.567977:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658768.567998:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.568003:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014a8fbb4/0x48e67cc629c705bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.568011:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.568016:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014a8fbb4/0x48e67cc629c705bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.568025:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014a8fbb4/0x48e67cc629c705bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.568271:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014a8fbb4/0x48e67cc629c705bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.568279:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014a8fbb4/0x48e67cc629c705bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.568297:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.568299:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.568300:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.569821:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.569835:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c705c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.569854:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.569860:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.569869:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c705c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.569887:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c705c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.569898:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c705c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.569906:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c705c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.569928:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.569943:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.569958:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c705c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.569966:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.569971:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c705c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.569982:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c705c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.570001:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c705c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.570010:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c705c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.570032:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.570034:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.570035:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.571547:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.571562:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be41eae9/0x48e67cc629c705cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.571579:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.571585:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.571592:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be41eae9/0x48e67cc629c705cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.571628:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be41eae9/0x48e67cc629c705cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.571641:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be41eae9/0x48e67cc629c705cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.571649:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be41eae9/0x48e67cc629c705cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.571675:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658768.571759:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788658768.571951:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.571957:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c705d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.571968:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.571971:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.571975:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c705d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.571987:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c705d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.571995:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c705d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.572015:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c705d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.572031:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658768.572169:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be41eae9/0x48e67cc629c705cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.572183:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.572188:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be41eae9/0x48e67cc629c705cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.572199:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be41eae9/0x48e67cc629c705cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.572222:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be41eae9/0x48e67cc629c705cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.572230:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be41eae9/0x48e67cc629c705cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.572258:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.572262:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c705d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.572268:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.572271:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c705d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.572279:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c705d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.572305:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c705d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.572313:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c705d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.572351:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.572354:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.572355:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.572633:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.574885:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.574901:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c705db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.574921:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.574926:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.574933:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c705db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.574949:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c705db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.574961:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c705db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.574968:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c705db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.574987:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658768.575399:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.575414:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c705db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.575433:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2044000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.575438:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c705db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.575448:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c705db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.575467:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c705db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.575474:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c705db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.575528:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.575530:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.575532:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658768.575628:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.575635:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c705e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.575647:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.575651:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.575658:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c705e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.575670:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c705e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.575678:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c705e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.575686:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c705e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.575723:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.576459:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.576472:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c705e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.576686:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.576693:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c705e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.576726:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c705e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.576750:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c705e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.576759:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c705e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.576786:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.576788:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.576789:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.576883:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.576890:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c705e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.576901:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.576909:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.576916:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c705e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.576929:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c705e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.576946:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c705e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.576954:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c705e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.576973:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.576986:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.576992:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c705e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.577001:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.577005:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c705e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.577014:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c705e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.577029:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c705e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.577038:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c705e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.577055:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.577062:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.577064:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658768.577447:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.577458:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad30064d/0x48e67cc629c705f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.577484:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.577489:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.577495:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad30064d/0x48e67cc629c705f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.577520:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad30064d/0x48e67cc629c705f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.577531:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad30064d/0x48e67cc629c705f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.577538:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad30064d/0x48e67cc629c705f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.577564:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.577835:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.577843:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad30064d/0x48e67cc629c705f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.577853:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.577856:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad30064d/0x48e67cc629c705f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.577865:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad30064d/0x48e67cc629c705f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.577879:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad30064d/0x48e67cc629c705f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.577887:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad30064d/0x48e67cc629c705f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.577905:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.577907:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.577909:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658768.578761:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.579022:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014a8fbb4/0x48e67cc629c705f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.579169:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.579174:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.579180:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014a8fbb4/0x48e67cc629c705f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.579194:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014a8fbb4/0x48e67cc629c705f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.579218:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014a8fbb4/0x48e67cc629c705f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.579226:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014a8fbb4/0x48e67cc629c705f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.579296:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658768.579767:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.579788:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001736e257/0x48e67cc629c705fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.579799:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.579803:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.579808:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001736e257/0x48e67cc629c705fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.579821:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001736e257/0x48e67cc629c705fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.579831:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001736e257/0x48e67cc629c705fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.579839:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001736e257/0x48e67cc629c705fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658768.580271:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.580283:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70605 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.580300:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.580302:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658768.580307:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.580323:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.580331:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014a8fbb4/0x48e67cc629c705f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.580340:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.580343:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.580352:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014a8fbb4/0x48e67cc629c705f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.580362:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.580368:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014a8fbb4/0x48e67cc629c705f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.580381:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.580398:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014a8fbb4/0x48e67cc629c705f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.580406:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788658768.580410:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014a8fbb4/0x48e67cc629c705f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.580421:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658768.580445:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658768.580451:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.580457:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.580461:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.580469:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70605 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.580507:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70605 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.580515:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70605 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.580538:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.580540:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.580543:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.581191:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.581202:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001736e257/0x48e67cc629c705fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581213:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.581218:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001736e257/0x48e67cc629c705fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581228:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001736e257/0x48e67cc629c705fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581267:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001736e257/0x48e67cc629c705fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581292:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.581294:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.581297:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.581360:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.581367:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7060c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581376:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.581380:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.581386:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7060c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581398:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7060c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581406:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7060c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581413:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7060c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581431:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.581551:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.581557:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7060c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581575:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.581579:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7060c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581586:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7060c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581598:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7060c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581605:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7060c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.581624:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.581626:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.581628:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.581633:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.581634:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.585413:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.585430:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076ad8b95/0x48e67cc629c70613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.585453:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.585459:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.585467:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076ad8b95/0x48e67cc629c70613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.585498:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076ad8b95/0x48e67cc629c70613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.585510:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076ad8b95/0x48e67cc629c70613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.585519:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076ad8b95/0x48e67cc629c70613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.585651:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658768.585666:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001736e257/0x48e67cc629c705fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.585962:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.586203:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.586213:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076ad8b95/0x48e67cc629c70613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.586226:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.586232:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076ad8b95/0x48e67cc629c70613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.586244:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076ad8b95/0x48e67cc629c70613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.586268:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076ad8b95/0x48e67cc629c70613 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.586277:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076ad8b95/0x48e67cc629c70613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.586278:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.586311:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.586314:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.586318:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.587286:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.587298:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d13c77fd/0x48e67cc629c7061a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.587314:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.587663:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.587674:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d13c77fd/0x48e67cc629c7061a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.587693:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d13c77fd/0x48e67cc629c7061a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.587734:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d13c77fd/0x48e67cc629c7061a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.587745:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d13c77fd/0x48e67cc629c7061a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.587769:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658768.588872:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.588882:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002f0b9ea/0x48e67cc629c70621 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.588894:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.588898:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.588903:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002f0b9ea/0x48e67cc629c70621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.589392:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002f0b9ea/0x48e67cc629c70621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.589405:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002f0b9ea/0x48e67cc629c70621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.589413:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002f0b9ea/0x48e67cc629c70621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.589442:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788658768.590603:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658768.590616:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d13c77fd/0x48e67cc629c7061a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.590641:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.590646:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d13c77fd/0x48e67cc629c7061a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.590656:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d13c77fd/0x48e67cc629c7061a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.590677:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d13c77fd/0x48e67cc629c7061a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.590685:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d13c77fd/0x48e67cc629c7061a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.590741:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.590745:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002f0b9ea/0x48e67cc629c70621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.590752:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.590756:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002f0b9ea/0x48e67cc629c70621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.590764:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002f0b9ea/0x48e67cc629c70621 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.590779:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658768.592084:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.592103:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c70628 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.592117:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.592122:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.592129:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c70628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.592167:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c70628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.592177:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c70628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.592184:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c70628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.592204:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.592426:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002f0b9ea/0x48e67cc629c70621 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592446:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002f0b9ea/0x48e67cc629c70621 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592466:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.592470:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c70628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592476:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.592480:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c70628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592488:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c70628 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592499:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c70628 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592520:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c70628 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592532:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.592534:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.592536:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.592547:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.592598:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.592613:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7062f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592621:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.592624:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.592629:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7062f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592639:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7062f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592647:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7062f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592653:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7062f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.592670:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.594300:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.594313:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7062f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658768.595293:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.595304:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c70636 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.595401:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.595407:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7062f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.595419:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7062f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.595459:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7062f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.595467:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f9afc2a/0x48e67cc629c7062f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.595489:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.595492:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.595494:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.596228:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.596235:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d334291c/0x48e67cc629c7063d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.596245:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.596249:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.596255:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d334291c/0x48e67cc629c7063d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.596267:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d334291c/0x48e67cc629c7063d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.596276:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d334291c/0x48e67cc629c7063d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.596283:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d334291c/0x48e67cc629c7063d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.596312:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658768.596398:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.596404:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.596409:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c70636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.596428:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c70636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.596441:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c70636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.596448:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c70636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.596462:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658768.596759:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658768.596765:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d334291c/0x48e67cc629c7063d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.597190:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.597196:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c70636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.597205:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2044000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.597209:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c70636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.597219:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c70636 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.597234:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c70636 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.597242:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c70636 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.597262:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.597265:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.597267:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.597997:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.598006:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d334291c/0x48e67cc629c7063d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.598018:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d334291c/0x48e67cc629c7063d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.598044:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d334291c/0x48e67cc629c7063d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.598053:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d334291c/0x48e67cc629c7063d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.598078:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.598090:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.598093:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658768.598186:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.598193:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c70644 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.598204:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.598208:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.598214:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c70644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.598225:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c70644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.598234:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c70644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.598242:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c70644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.598259:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.598689:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.598696:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c70644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.598721:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.598733:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c70644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.598742:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c70644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.598754:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c70644 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.598761:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c70644 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.599316:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.599611:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.599615:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.599687:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.599695:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a14d053/0x48e67cc629c7064b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.599728:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.599732:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.599738:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a14d053/0x48e67cc629c7064b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.599751:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a14d053/0x48e67cc629c7064b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.599762:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a14d053/0x48e67cc629c7064b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.600887:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a14d053/0x48e67cc629c7064b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.600925:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658768.601281:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.601288:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a14d053/0x48e67cc629c7064b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.601296:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.601301:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a14d053/0x48e67cc629c7064b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.601483:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a14d053/0x48e67cc629c7064b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.601503:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a14d053/0x48e67cc629c7064b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.602595:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a14d053/0x48e67cc629c7064b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.602625:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.602627:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.602629:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658768.602734:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.602741:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be41eae9/0x48e67cc629c70652 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.602752:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.602756:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.602763:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be41eae9/0x48e67cc629c70652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.602776:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be41eae9/0x48e67cc629c70652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.602785:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be41eae9/0x48e67cc629c70652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.602802:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be41eae9/0x48e67cc629c70652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.602820:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788658768.604296:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.604308:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70659 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604321:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.604325:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.604330:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604343:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604352:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604361:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604377:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788658768.604416:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658768.604433:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be41eae9/0x48e67cc629c70652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604452:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.604457:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be41eae9/0x48e67cc629c70652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604467:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be41eae9/0x48e67cc629c70652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604485:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be41eae9/0x48e67cc629c70652 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604493:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be41eae9/0x48e67cc629c70652 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604522:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.604526:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604532:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.604536:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604543:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604553:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70659 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604567:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70659 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.604580:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.604582:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.604584:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.604870:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658768.605241:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.605250:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70660 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.605260:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.605264:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.605269:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.605280:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.605288:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.605297:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.605319:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.605492:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.605499:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.605649:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.605655:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.605664:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70660 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.605680:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70660 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.605687:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c70660 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.605731:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.605734:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.605736:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658768.608753:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658768.608771:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c70667 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.608789:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.608795:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658768.608802:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c70667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.608819:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c70667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.608831:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c70667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.608839:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c70667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.608878:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788658768.610250:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658768.610261:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d6f63db/0x48e67cc629c7066e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.610274:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.610278:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658768.610284:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d6f63db/0x48e67cc629c7066e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.610296:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d6f63db/0x48e67cc629c7066e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.610306:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d6f63db/0x48e67cc629c7066e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.610313:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d6f63db/0x48e67cc629c7066e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.610331:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00080000:0.0:1788658768.610652:0:25042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1788658768.610686:0:25042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788658768.610692:0:25042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1788658768.610885:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658768.610894:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0bea886/0x48e67cc629c70675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.610903:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.610913:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658768.610918:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0bea886/0x48e67cc629c70675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.610928:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0bea886/0x48e67cc629c70675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.610937:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0bea886/0x48e67cc629c70675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.610944:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0bea886/0x48e67cc629c70675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.610963:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788658768.611238:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23466:x1875544025337600:12345-0@lo:5:osp-pre-1-1.0 Request processed in 59478us (59591us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788658768.611253:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788658768.611265:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788658768.611285:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c70667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.611294:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.611301:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c70667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.611312:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c70667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.611331:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c70667 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.611340:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c70667 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658768.611340:0:23466:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788658768.611357:0:23466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d823a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23466:1875544025337600:0@lo:5:osp-pre-1-1.0 00010000:00010000:2.0:1788658768.611370:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658768.611384:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d6f63db/0x48e67cc629c7066e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.611392:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.611396:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d6f63db/0x48e67cc629c7066e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658768.611403:0:23466:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00010000:00010000:2.0:1788658768.611404:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d6f63db/0x48e67cc629c7066e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658768.611486:0:23466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d823a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23466:1875544025337728:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788658768.611942:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658768.611951:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a33f49ba/0x48e67cc629c7067c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.611960:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.611963:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658768.611968:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a33f49ba/0x48e67cc629c7067c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.611979:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a33f49ba/0x48e67cc629c7067c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.611986:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a33f49ba/0x48e67cc629c7067c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.612000:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a33f49ba/0x48e67cc629c7067c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.612009:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658768.612218:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d6f63db/0x48e67cc629c7066e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612226:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d6f63db/0x48e67cc629c7066e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612242:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658768.612246:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0bea886/0x48e67cc629c70675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612253:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.612257:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0bea886/0x48e67cc629c70675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612265:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0bea886/0x48e67cc629c70675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612274:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0bea886/0x48e67cc629c70675 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612281:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0bea886/0x48e67cc629c70675 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612293:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.612297:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a33f49ba/0x48e67cc629c7067c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612309:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.612313:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a33f49ba/0x48e67cc629c7067c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612320:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a33f49ba/0x48e67cc629c7067c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612329:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a33f49ba/0x48e67cc629c7067c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612336:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a33f49ba/0x48e67cc629c7067c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.612348:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.612349:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.612351:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.612771:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658768.613011:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658768.613018:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000181b835f/0x48e67cc629c70683 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.613028:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.613032:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658768.613168:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000181b835f/0x48e67cc629c70683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.613184:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000181b835f/0x48e67cc629c70683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.613193:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000181b835f/0x48e67cc629c70683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.613200:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000181b835f/0x48e67cc629c70683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.613263:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788658768.613421:0:23466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658768.613479:0:23466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec121b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658768.613557:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025337728 00000100:00100000:1.0:1788658768.613567:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025337728 00000100:00100000:1.0:1788658768.613625:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658768.613634:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23466:x1875544025337728:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788658768.613752:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23466:x1875544025337728:12345-0@lo:900:osp-pre-1-1.0 Request processed in 118us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.613759:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:1.0:1788658768.614104:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658768.614110:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a19fa77a/0x48e67cc629c7068a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.614121:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.614124:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658768.614129:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a19fa77a/0x48e67cc629c7068a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.614139:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a19fa77a/0x48e67cc629c7068a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.614158:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a19fa77a/0x48e67cc629c7068a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.614166:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a19fa77a/0x48e67cc629c7068a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788658768.614235:0:23466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d823a9f80 x1875544025337728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788658784 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658768.614255:0:23466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d823a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23466:1875544025337728:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788658768.614335:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658768.614344:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000181b835f/0x48e67cc629c70683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.614354:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.614359:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000181b835f/0x48e67cc629c70683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.614386:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000181b835f/0x48e67cc629c70683 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.614403:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000181b835f/0x48e67cc629c70683 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.614412:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000181b835f/0x48e67cc629c70683 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.614448:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.614451:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a19fa77a/0x48e67cc629c7068a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.614458:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.614462:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a19fa77a/0x48e67cc629c7068a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.614469:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a19fa77a/0x48e67cc629c7068a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.614480:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a19fa77a/0x48e67cc629c7068a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.614487:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.614489:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.614498:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.614679:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788658768.614686:0:24227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a19fa77a/0x48e67cc629c7068a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658768.614897:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.614909:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70691 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.614924:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.614929:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.614936:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.614951:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.614962:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.614970:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658768.615375:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658768.615384:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047db98e3/0x48e67cc629c70698 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.615396:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.615400:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658768.615406:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047db98e3/0x48e67cc629c70698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.615418:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047db98e3/0x48e67cc629c70698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.615439:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047db98e3/0x48e67cc629c70698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.615447:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047db98e3/0x48e67cc629c70698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.615570:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658768.615578:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70691 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.615587:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.615592:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70691 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.615601:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70691 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.615613:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70691 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.615648:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.615652:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047db98e3/0x48e67cc629c70698 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.615659:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.615662:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047db98e3/0x48e67cc629c70698 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.615671:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047db98e3/0x48e67cc629c70698 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.615683:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047db98e3/0x48e67cc629c70698 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.615718:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.615720:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.615725:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.616484:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788658768.617102:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.617156:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70691 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.617738:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788658768.617751:0:24227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047db98e3/0x48e67cc629c70698 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.618259:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.618373:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.618385:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c7069f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.618403:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.618417:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.618426:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c7069f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.618447:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c7069f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.618460:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c7069f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.618470:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c7069f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658768.618719:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658768.618730:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd9e1373/0x48e67cc629c706a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.618758:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.618762:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658768.618769:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd9e1373/0x48e67cc629c706a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.618880:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd9e1373/0x48e67cc629c706a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.618893:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd9e1373/0x48e67cc629c706a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.618902:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd9e1373/0x48e67cc629c706a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.621659:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658768.621678:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c7069f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.621694:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.621700:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c7069f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.621738:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c7069f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.621761:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c7069f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.621775:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.621791:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd9e1373/0x48e67cc629c706a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.621797:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.621800:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd9e1373/0x48e67cc629c706a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.621830:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd9e1373/0x48e67cc629c706a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.621843:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd9e1373/0x48e67cc629c706a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.621852:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.621854:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.621856:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.622032:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788658768.622048:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c7069f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.622206:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788658768.622218:0:24227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd9e1373/0x48e67cc629c706a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658768.623205:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658768.623216:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2ddf60/0x48e67cc629c706ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.623232:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1788658768.623237:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658768.623245:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2ddf60/0x48e67cc629c706ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.623274:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2ddf60/0x48e67cc629c706ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.623286:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2ddf60/0x48e67cc629c706ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.623295:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b2ddf60/0x48e67cc629c706ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.623390:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.623398:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b2ddf60/0x48e67cc629c706ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.623407:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.623412:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2ddf60/0x48e67cc629c706ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.623421:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2ddf60/0x48e67cc629c706ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.623500:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b2ddf60/0x48e67cc629c706ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.623671:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.623674:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.623676:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.625487:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658768.626251:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658768.626268:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b06b95d/0x48e67cc629c706b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.626290:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1788658768.626296:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658768.626316:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b06b95d/0x48e67cc629c706b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.626336:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b06b95d/0x48e67cc629c706b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.626350:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b06b95d/0x48e67cc629c706b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.626360:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b06b95d/0x48e67cc629c706b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.626399:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658768.626910:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658768.626926:0:24227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2ddf60/0x48e67cc629c706ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.626934:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.626949:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b06b95d/0x48e67cc629c706b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.626959:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf602600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.626965:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b06b95d/0x48e67cc629c706b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.626975:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b06b95d/0x48e67cc629c706b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.627011:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b06b95d/0x48e67cc629c706b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.627028:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b06b95d/0x48e67cc629c706b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658768.627234:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658768.627240:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004651055c/0x48e67cc629c706bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.627250:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1788658768.627253:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658768.627258:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004651055c/0x48e67cc629c706bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.627267:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004651055c/0x48e67cc629c706bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.627275:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004651055c/0x48e67cc629c706bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.627282:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004651055c/0x48e67cc629c706bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.627314:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658768.627338:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658768.627348:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004651055c/0x48e67cc629c706bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.627358:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.627365:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004651055c/0x48e67cc629c706bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.627379:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004651055c/0x48e67cc629c706bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.627404:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004651055c/0x48e67cc629c706bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658768.627826:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658768.627832:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ad62c90/0x48e67cc629c706c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.627842:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1788658768.627852:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658768.627871:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ad62c90/0x48e67cc629c706c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.627881:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004651055c/0x48e67cc629c706bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.627891:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ad62c90/0x48e67cc629c706c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.627904:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ad62c90/0x48e67cc629c706c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.627912:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658768.627913:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ad62c90/0x48e67cc629c706c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.627920:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.627925:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658768.627945:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658768.627956:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658768.627963:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ad62c90/0x48e67cc629c706c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.627972:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf602a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.627976:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ad62c90/0x48e67cc629c706c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.627985:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ad62c90/0x48e67cc629c706c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.628001:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ad62c90/0x48e67cc629c706c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.628008:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ad62c90/0x48e67cc629c706c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.628023:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.628026:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.628028:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658768.628100:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658768.628106:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c706c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.628115:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1788658768.628118:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658768.628122:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c706c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.628134:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c706c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.628153:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c706c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.628189:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c706c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.628200:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.628386:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.628392:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.628397:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c706c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.628405:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.628410:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c706c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.628418:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c706c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.628432:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c706c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.628441:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c706c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.628457:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.628466:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.628468:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.628636:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.628685:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658768.628886:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658768.628895:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edc3d2d0/0x48e67cc629c706d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.628905:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1788658768.628909:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658768.628913:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edc3d2d0/0x48e67cc629c706d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.628924:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edc3d2d0/0x48e67cc629c706d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.628933:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edc3d2d0/0x48e67cc629c706d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.628940:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edc3d2d0/0x48e67cc629c706d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.628956:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658768.629177:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.629184:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c706d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.629192:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.629195:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.629199:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c706d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.629209:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c706d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.629216:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c706d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.629222:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c706d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.629245:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788658768.629491:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658768.629507:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edc3d2d0/0x48e67cc629c706d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.629524:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658768.629528:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edc3d2d0/0x48e67cc629c706d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.629537:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edc3d2d0/0x48e67cc629c706d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.629551:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edc3d2d0/0x48e67cc629c706d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.629563:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edc3d2d0/0x48e67cc629c706d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.629580:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658768.629583:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c706d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.629590:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658768.629593:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c706d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.629601:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c706d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.629610:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c706d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.629624:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007897950/0x48e67cc629c706d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658768.629640:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658768.629642:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658768.629644:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658768.630863:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.630875:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c706de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.630888:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.630891:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.630896:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c706de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.630918:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c706de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.630926:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c706de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.630931:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c706de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.630943:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658768.630953:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.630958:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c706de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.630962:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.630965:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c706de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.630971:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c706de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.630982:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c706de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.630986:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d41cbe9/0x48e67cc629c706de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.631011:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.631013:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.631015:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658768.631278:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.631283:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0909e4a/0x48e67cc629c706e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.631290:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.631292:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.631295:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0909e4a/0x48e67cc629c706e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.631929:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.632475:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0909e4a/0x48e67cc629c706e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632490:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0909e4a/0x48e67cc629c706e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632496:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0909e4a/0x48e67cc629c706e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632515:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788658768.632602:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.632613:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000887db2a5/0x48e67cc629c706ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.632630:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.632635:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.632640:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000887db2a5/0x48e67cc629c706ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.632652:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000887db2a5/0x48e67cc629c706ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.632660:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000887db2a5/0x48e67cc629c706ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.632667:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000887db2a5/0x48e67cc629c706ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.632692:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658768.632825:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658768.632832:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0909e4a/0x48e67cc629c706e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632849:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.632855:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0909e4a/0x48e67cc629c706e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632862:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0909e4a/0x48e67cc629c706e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632877:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0909e4a/0x48e67cc629c706e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632882:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0909e4a/0x48e67cc629c706e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632900:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.632903:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000887db2a5/0x48e67cc629c706ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632907:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.632909:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000887db2a5/0x48e67cc629c706ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632914:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000887db2a5/0x48e67cc629c706ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632920:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000887db2a5/0x48e67cc629c706ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.632933:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000887db2a5/0x48e67cc629c706ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633129:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.633133:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.633137:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.633186:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.633196:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c706f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633204:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.633207:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1788658768.633217:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.633218:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c706f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633228:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c72d23/0x48e67cc629c706fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633234:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c706f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633238:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.633243:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c706f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633245:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.633263:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c72d23/0x48e67cc629c706fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633265:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c706f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633306:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.633314:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.633318:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c706f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633324:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.633327:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c706f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633333:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c706f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633344:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c706f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633356:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ad8b95/0x48e67cc629c706f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633367:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c72d23/0x48e67cc629c706fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633369:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.633377:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.633382:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.633393:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c72d23/0x48e67cc629c706fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633399:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c72d23/0x48e67cc629c706fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633416:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658768.633537:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.633558:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.633569:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c72d23/0x48e67cc629c706fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633575:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.633578:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c72d23/0x48e67cc629c706fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633584:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c72d23/0x48e67cc629c706fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633593:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c72d23/0x48e67cc629c706fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633597:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c72d23/0x48e67cc629c706fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.633623:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.633625:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.633630:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.633666:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.633671:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70701 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633678:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.633681:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.633684:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633692:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633697:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633739:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.633758:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658768.633898:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658768.633903:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.633908:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.633911:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.633917:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.633925:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70701 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.633930:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c70701 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.633941:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.633942:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.633943:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.634313:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.634322:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70708 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.634328:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.634330:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.634333:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.634339:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.634343:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.634349:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658768.635420:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.635497:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aec10554/0x48e67cc629c7070f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.635512:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.635517:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.635525:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aec10554/0x48e67cc629c7070f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.635555:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aec10554/0x48e67cc629c7070f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.635567:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aec10554/0x48e67cc629c7070f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.635576:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aec10554/0x48e67cc629c7070f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.635680:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788658768.636478:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.636486:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f9afc2a/0x48e67cc629c70716 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.636499:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.636502:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.636516:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f9afc2a/0x48e67cc629c70716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.636527:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f9afc2a/0x48e67cc629c70716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.636538:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f9afc2a/0x48e67cc629c70716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.636543:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f9afc2a/0x48e67cc629c70716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637757:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788658768.637787:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788658768.637793:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637801:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.637805:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637812:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637826:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70708 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637831:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceb65ad6/0x48e67cc629c70708 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637856:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658768.637859:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aec10554/0x48e67cc629c7070f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637863:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.637865:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aec10554/0x48e67cc629c7070f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637869:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aec10554/0x48e67cc629c7070f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637875:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aec10554/0x48e67cc629c7070f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637879:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aec10554/0x48e67cc629c7070f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637888:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.637890:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f9afc2a/0x48e67cc629c70716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637894:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.637896:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f9afc2a/0x48e67cc629c70716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637907:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f9afc2a/0x48e67cc629c70716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637913:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f9afc2a/0x48e67cc629c70716 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.637917:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.637918:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.637919:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.638413:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788658768.638419:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f9afc2a/0x48e67cc629c70716 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.638602:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658768.638660:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.638664:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7eacaf/0x48e67cc629c7071d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.638673:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.638676:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.638681:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7eacaf/0x48e67cc629c7071d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.638690:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf7eacaf/0x48e67cc629c7071d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.638696:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7eacaf/0x48e67cc629c7071d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.638872:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7eacaf/0x48e67cc629c7071d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.638901:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788658768.639040:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.639120:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c70724 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.639130:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.639134:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.639139:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c70724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.639162:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c70724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.639175:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c70724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.639194:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c70724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.639216:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658768.639235:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658768.639236:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.639258:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf7eacaf/0x48e67cc629c7071d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.639259:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c70724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.639301:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.639304:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.639311:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c70724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.639320:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7eacaf/0x48e67cc629c7071d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.639365:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7eacaf/0x48e67cc629c7071d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.639367:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c70724 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.639410:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf7eacaf/0x48e67cc629c7071d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.639412:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c70724 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.639443:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c70724 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.639446:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7eacaf/0x48e67cc629c7071d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.639517:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.639517:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.639523:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.639526:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.639528:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.639532:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.639626:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.639631:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c7072b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.639638:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.639640:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.639643:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c7072b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658768.639647:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.639651:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c7072b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.639658:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3237e3/0x48e67cc629c70732 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.639660:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c7072b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.639696:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c7072b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.639846:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.639861:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.639868:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f3237e3/0x48e67cc629c70732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.639882:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f3237e3/0x48e67cc629c70732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.639892:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3237e3/0x48e67cc629c70732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.639901:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f3237e3/0x48e67cc629c70732 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.640018:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788658768.640141:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658768.640252:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658768.640260:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f3237e3/0x48e67cc629c70732 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.640269:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.640274:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3237e3/0x48e67cc629c70732 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.640283:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3237e3/0x48e67cc629c70732 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.640298:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f3237e3/0x48e67cc629c70732 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658768.640469:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.640474:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff54e846/0x48e67cc629c70739 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.640486:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.640488:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.640492:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff54e846/0x48e67cc629c70739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.640499:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff54e846/0x48e67cc629c70739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.640505:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff54e846/0x48e67cc629c70739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.640587:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff54e846/0x48e67cc629c70739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.640601:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788658768.640627:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658768.640632:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c7072b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.640641:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.640645:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c7072b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.640654:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c7072b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.640667:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c7072b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.640686:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c7072b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.640723:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658768.640728:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff54e846/0x48e67cc629c70739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.640734:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.640738:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff54e846/0x48e67cc629c70739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.640746:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff54e846/0x48e67cc629c70739 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.640756:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff54e846/0x48e67cc629c70739 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.640764:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff54e846/0x48e67cc629c70739 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.640776:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.640778:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.640780:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.640931:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.640936:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b45cb7b/0x48e67cc629c70740 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.640942:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.640944:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.640947:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b45cb7b/0x48e67cc629c70740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.640953:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b45cb7b/0x48e67cc629c70740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.640966:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b45cb7b/0x48e67cc629c70740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.640970:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b45cb7b/0x48e67cc629c70740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.640982:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658768.641005:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658768.641022:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b45cb7b/0x48e67cc629c70740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641035:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.641039:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b45cb7b/0x48e67cc629c70740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641201:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b45cb7b/0x48e67cc629c70740 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641214:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b45cb7b/0x48e67cc629c70740 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641222:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b45cb7b/0x48e67cc629c70740 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641236:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.641237:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.641239:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.641296:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.641300:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c70747 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.641306:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.641308:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.641311:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c70747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.641317:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c70747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.641322:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c70747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.641327:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c70747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.641346:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658768.641367:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658768.641372:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c70747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641379:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.641382:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c70747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641391:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c70747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641408:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c70747 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641415:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c70747 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641429:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.641430:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.641432:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.641602:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.641606:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008871a632/0x48e67cc629c7074e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.641612:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.641614:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.641617:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008871a632/0x48e67cc629c7074e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.641623:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008871a632/0x48e67cc629c7074e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.641628:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008871a632/0x48e67cc629c7074e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.641632:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008871a632/0x48e67cc629c7074e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.641644:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658768.641665:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658768.641670:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008871a632/0x48e67cc629c7074e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641677:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658768.641680:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008871a632/0x48e67cc629c7074e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641688:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008871a632/0x48e67cc629c7074e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641699:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008871a632/0x48e67cc629c7074e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641727:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008871a632/0x48e67cc629c7074e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658768.641753:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.641754:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.641756:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658768.642039:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658768.642168:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c70755 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.642177:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.642187:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658768.642191:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c70755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.642202:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c70755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.642246:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f3237e3/0x48e67cc629c70732 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.642276:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c70755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.642283:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.642286:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c70755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.642288:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.642294:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.642317:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658768.642379:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658768.642389:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c70755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.642401:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658768.642407:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c70755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.642419:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c70755 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.642436:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c70755 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.642444:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c70755 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.642464:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.642466:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.642467:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658768.642913:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788658768.643640:0:24225:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1788658768.643771:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22749:x1875544025336832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 123714us (124116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658768.644247:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22749:1875544025336832:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788658768.644249:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:1.0:1788658768.644273:0:22749:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788658768.644331:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22749:1875544025337856:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788658768.644369:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658768.644396:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebc812180 going to sleep for 11 seconds 00000100:00100000:1.0:1788658768.644419:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025337856 00000100:00100000:1.0:1788658768.644426:0:25305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025337856 00000100:00100000:1.0:1788658768.644478:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00002000:00010000:2.0:1788658768.644488:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1788658768.644495:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22749:x1875544025337856:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1788658768.644506:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049746aba/0x48e67cc629c7075c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.644530:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=685s v=(0 0) 00010000:00010000:2.0:1788658768.644536:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00002000:00080000:1.0:1788658768.644543:0:24228:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:2.0:1788658768.644545:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049746aba/0x48e67cc629c7075c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.644565:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049746aba/0x48e67cc629c7075c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.644577:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049746aba/0x48e67cc629c7075c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.644585:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049746aba/0x48e67cc629c7075c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.644617:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658768.644894:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.644905:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049746aba/0x48e67cc629c7075c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.645155:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.645164:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049746aba/0x48e67cc629c7075c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.645177:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049746aba/0x48e67cc629c7075c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658768.645205:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658768.645214:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003426adad/0x48e67cc629c70763 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.645220:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049746aba/0x48e67cc629c7075c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.645232:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1788658768.645240:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049746aba/0x48e67cc629c7075c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.645240:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658768.645253:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003426adad/0x48e67cc629c70763 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.645280:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.645286:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.645288:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003426adad/0x48e67cc629c70763 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.645290:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658768.645304:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003426adad/0x48e67cc629c70763 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.645312:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003426adad/0x48e67cc629c70763 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658768.645335:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788658768.645378:0:24227:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:2.0:1788658768.645481:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22747:x1875544025337344:12345-0@lo:5:osp-pre-0-0.0 Request processed in 115598us (119453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658768.645492:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788658768.645771:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658768.645780:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003426adad/0x48e67cc629c70763 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.645865:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658768.645870:0:25306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003426adad/0x48e67cc629c70763 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.645879:0:25306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003426adad/0x48e67cc629c70763 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.645893:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003426adad/0x48e67cc629c70763 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.645902:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003426adad/0x48e67cc629c70763 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658768.645932:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.645934:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658768.645936:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658768.645983:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22747:1875544025337344:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788658768.646000:0:22747:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1788658768.646585:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22747:1875544025337984:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788658768.646645:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658768.646683:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9804d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658768.647378:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025337984 00000100:00100000:0.0:1788658768.647396:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025337984 00000100:00100000:0.0:1788658768.647492:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788658768.647690:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22747:x1875544025337984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788658768.647814:0:24896:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000100:00100000:1.0:1788658768.650799:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22749:x1875544025337856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6302us (6421us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788658768.650812:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658768.651188:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22749:1875544025337856:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788658768.651210:0:22749:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000001:00080000:3.0:1788658768.662171:0:24222:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1788658768.662221:0:24222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788658768.662865:0:22747:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788658768.662886:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22747:1875544025337984:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788658768.662912:0:22747:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:2.0:1788658768.663367:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22747:x1875544025337984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15681us (16716us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788658768.663381:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788658769.086968:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658770.110924:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788658770.796472:0:25400:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788658771.134914:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788658771.672903:0:25452:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658771.673225:0:25452:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788658771.906086:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658771.906113:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025338112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658771.906192:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658771.906774:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025338112 00000100:00100000:1.0:1788658771.906784:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025338112 00000100:00100000:1.0:1788658771.906856:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658771.906868:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025338112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658771.906900:0:24230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788658771.906972:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025338112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658771.906979:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658771.907041:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025338112:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788658771.907104:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788658772.159880:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658772.420424:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025338240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658772.420500:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658772.420554:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658772.420562:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025338368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658772.420586:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658772.420641:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025338240 00000100:00100000:2.0:1788658772.420648:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025338240 00000100:00100000:2.0:1788658772.420689:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025338368 00000100:00100000:2.0:1788658772.420692:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025338368 00000100:00100000:2.0:1788658772.420727:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788658772.420746:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025338240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658772.420788:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788658772.420919:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025338240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658772.420927:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788658772.420946:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658772.420952:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025338368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658772.420970:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788658772.420999:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025338368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658772.421005:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788658772.429470:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025338240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658772.429695:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025338368:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788658772.495060:0:25502:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658772.495326:0:25502:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788658772.872003:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658772.872097:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001102336 00000100:00100000:2.0:1788658772.872107:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001102336 00000100:00100000:2.0:1788658772.872158:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 114 00000100:00100000:2.0:1788658772.872167:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2395:x1875544001102336:12345-192.168.202.53@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788658772.872206:0:22715:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a253e119-3367-4bac-b369-351e630e7e49@192.168.202.53@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1788658772.872403:0:22715:0:(genops.c:1385:class_connect()) connect: client a253e119-3367-4bac-b369-351e630e7e49, cookie 0x48e67cc629c7076a 00000100:00080000:2.0:1788658772.872554:0:22715:0:(import.c:65:import_set_state_nolock()) ffff8a1d8219e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658772.872632:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+5:2395:x1875544001102336:12345-192.168.202.53@tcp:250:mount.lustre.0 Request processed in 464us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658772.872640:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 114 00000100:00100000:2.0:1788658772.879660:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658772.879744:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001102464 00000100:00100000:1.0:1788658772.879754:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001102464 00000100:00100000:1.0:1788658772.879809:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 115 00000100:00100000:1.0:1788658772.879818:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+5:18048:x1875544001102464:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788658772.879835:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658772.879851:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c70771 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcccab expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658772.879879:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c70771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccab expref: 6 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658772.879891:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c70771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccab expref: 6 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658772.879913:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96e00, rc 0) 00000100:00100000:1.0:1788658772.879965:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+6:18048:x1875544001102464:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 147us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658772.879972:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 115 00000100:00100000:3.0:1788658772.887054:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658772.890824:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001102592 00000100:00100000:2.0:1788658772.890842:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001102592 00000100:00100000:2.0:1788658772.891124:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 116 00000100:00100000:2.0:1788658772.891137:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+6:18048:x1875544001102592:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788658772.891322:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+6:18048:x1875544001102592:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 186us (4277us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658772.891330:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 116 00000100:00100000:0.0:1788658772.893596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658772.894144:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001102720 00000100:00100000:1.0:1788658772.894155:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001102720 00000100:00100000:1.0:1788658772.894564:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:1.0:1788658772.894590:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+6:18048:x1875544001102720:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788658772.894608:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658772.894624:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c70778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcccb2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658772.894654:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c70778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccb2 expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658772.894665:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c70778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccb2 expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658772.894675:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96000, rc 0) 00000100:00100000:1.0:1788658772.894812:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+7:18048:x1875544001102720:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 223us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658772.894819:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:3.0:1788658772.896957:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658772.897176:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001102848 00000100:00100000:1.0:1788658772.897477:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001102848 00000100:00100000:1.0:1788658772.897667:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:1.0:1788658772.897678:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8366a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+7:18048:x1875544001102848:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788658772.897889:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8366a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+8:18048:x1875544001102848:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 212us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658772.897909:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:0.0:1788658772.902196:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658772.902297:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001102976 00000100:00100000:3.0:1788658772.902308:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001102976 00000100:00100000:3.0:1788658772.902371:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 119 00000100:00100000:3.0:1788658772.902383:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+8:18048:x1875544001102976:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788658772.902556:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+8:18048:x1875544001102976:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 174us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658772.902564:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 119 00000100:00100000:0.0:1788658772.910036:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658772.910397:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001103104 00000100:00100000:1.0:1788658772.910412:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001103104 00000100:00100000:1.0:1788658772.910474:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 120 00000100:00100000:1.0:1788658772.910494:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+8:18067:x1875544001103104:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658772.910647:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+8:18067:x1875544001103104:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 163us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658772.910660:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 120 00000100:00100000:0.0:1788658772.946659:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658772.947642:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001103232 00000100:00100000:2.0:1788658772.947653:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001103232 00000100:00100000:0.0:1788658772.948122:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:0.0:1788658772.948150:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+8:18067:x1875544001103232:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658772.948337:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+8:18067:x1875544001103232:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 188us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658772.948345:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:0.0:1788658772.961148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658772.961267:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001103360 00000100:00100000:3.0:1788658772.961278:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001103360 00000100:00100000:3.0:1788658772.961339:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:3.0:1788658772.961351:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec20ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+8:18067:x1875544001103360:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788658772.961517:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec20ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+8:18067:x1875544001103360:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 167us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658772.961525:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:3.0:1788658772.966557:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658772.966787:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001103488 00000100:00100000:0.0:1788658772.966796:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001103488 00000100:00100000:0.0:1788658772.966852:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:0.0:1788658772.966863:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec20cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+8:18048:x1875544001103488:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788658772.966879:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658772.966919:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ebf602600/0x48e67cc629c7077f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccce3 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658772.966948:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf602600/0x48e67cc629c7077f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccce3 expref: 9 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658772.966959:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ebf602600/0x48e67cc629c7077f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccce3 expref: 9 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658772.966975:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf602600, rc 0) 00000100:00100000:0.0:1788658772.967048:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec20cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+9:18048:x1875544001103488:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 186us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658772.967056:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:0.0:1788658772.981283:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658772.981432:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001103616 00000100:00100000:1.0:1788658772.981442:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001103616 00000100:00100000:1.0:1788658772.981500:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 124 00000100:00100000:1.0:1788658772.981510:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+9:18048:x1875544001103616:12345-192.168.202.53@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788658772.981537:0:22714:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788658772.981565:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788658772.981569:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788658772.981572:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788658772.981574:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788658772.981577:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788658772.985574:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+9:18048:x1875544001103616:12345-192.168.202.53@tcp:256:mount.lustre.0 Request processed in 4051us (4289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658772.985603:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 124 00000100:00100000:3.0:1788658772.988821:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658772.989020:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001103744 00000100:00100000:2.0:1788658772.989030:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001103744 00000100:00100000:2.0:1788658772.989077:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00100000:2.0:1788658772.989087:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+9:18048:x1875544001103744:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658772.989103:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658772.989121:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c70786 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcccea expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658772.989150:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c70786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccea expref: 10 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658772.989161:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c70786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccea expref: 10 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658772.989170:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1e00, rc 0) 00000100:00100000:2.0:1788658772.989240:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+10:18048:x1875544001103744:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 154us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658772.989248:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00100000:0.0:1788658772.997147:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658772.997534:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001103872 00000100:00100000:3.0:1788658772.997546:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001103872 00000100:00100000:3.0:1788658772.997997:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 126 00000100:00100000:3.0:1788658772.998008:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+10:18048:x1875544001103872:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788658772.998185:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+10:18048:x1875544001103872:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 178us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658772.998194:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 126 00000100:00100000:1.0:1788658773.010396:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658773.010592:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001104000 00000100:00100000:0.0:1788658773.010603:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001104000 00000100:00100000:0.0:1788658773.010681:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:0.0:1788658773.010691:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+10:18048:x1875544001104000:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788658773.010859:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+10:18048:x1875544001104000:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 168us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658773.010868:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:0.0:1788658773.029908:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658773.032488:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001104128 00000100:00100000:2.0:1788658773.032502:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001104128 00000100:00100000:2.0:1788658773.032586:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:2.0:1788658773.032596:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+10:18071:x1875544001104128:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658773.032805:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+10:18071:x1875544001104128:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 210us (2907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.032813:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:1.0:1788658773.039251:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658773.039500:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001104256 00000100:00100000:3.0:1788658773.039522:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001104256 00000100:00100000:3.0:1788658773.039593:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00100000:3.0:1788658773.039618:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+10:18071:x1875544001104256:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788658773.039803:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+10:18071:x1875544001104256:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 187us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658773.039811:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00100000:1.0:1788658773.064868:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658773.064951:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658773.065055:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001104384 00000100:00100000:2.0:1788658773.065065:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001104384 00000100:00100000:2.0:1788658773.065111:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001104640 00000100:00100000:2.0:1788658773.065118:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001104640 00000100:00100000:2.0:1788658773.065132:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1788658773.065139:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1875544001104384:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788658773.065170:0:22723:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd@192.168.202.53@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1788658773.065232:0:22723:0:(genops.c:1385:class_connect()) connect: client 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd, cookie 0x48e67cc629c7078d 00000004:00100000:2.0:1788658773.065257:0:22723:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788658773.065486:0:22723:0:(import.c:65:import_set_state_nolock()) ffff8a1d8219b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658773.065561:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:2395:x1875544001104384:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 419us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.065570:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1788658773.065605:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1788658773.065610:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1875544001104640:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788658773.065627:0:22723:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd@192.168.202.53@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1788658773.065673:0:22723:0:(genops.c:1385:class_connect()) connect: client 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd, cookie 0x48e67cc629c70794 00000004:00100000:2.0:1788658773.065688:0:22723:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788658773.065854:0:22723:0:(import.c:65:import_set_state_nolock()) ffff8a1d82199000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658773.065880:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:2395:x1875544001104640:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 268us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.065901:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:0.0:1788658773.075502:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658773.075595:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001104896 00000100:00100000:2.0:1788658773.075607:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001104896 00000100:00100000:2.0:1788658773.075696:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:2.0:1788658773.075744:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18048:x1875544001104896:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788658773.075812:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788658773.076118:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18048:x1875544001104896:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 412us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.076126:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00080000:3.0:1788658773.076472:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658773.081537:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658773.081731:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658773.082349:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001104768 00000100:00100000:3.0:1788658773.082360:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001104768 00000100:00100000:3.0:1788658773.082425:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001104512 00000100:00100000:3.0:1788658773.082429:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001104512 00000100:00100000:3.0:1788658773.082450:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:3.0:1788658773.082459:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:0:x1875544001104768:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788658773.082498:0:22724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788658773.082597:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:0:x1875544001104768:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 124us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658773.082606:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:3.0:1788658773.082623:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:3.0:1788658773.082630:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:0:x1875544001104512:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788658773.082642:0:22724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788658773.082671:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:0:x1875544001104512:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 41us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658773.082677:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00080000:0.0:1788658773.083256:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788658773.087842:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658773.087953:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001105024 00000100:00100000:3.0:1788658773.087964:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001105024 00000100:00100000:3.0:1788658773.088078:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:3.0:1788658773.088090:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18048:x1875544001105024:12345-192.168.202.53@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788658773.088200:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18048:x1875544001105024:12345-192.168.202.53@tcp:40:mount.lustre.0 Request processed in 112us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658773.088207:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1788658773.091368:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658773.091599:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001105408 00000100:00100000:1.0:1788658773.091612:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001105408 00000100:00100000:1.0:1788658773.091744:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:1.0:1788658773.091758:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18048:x1875544001105408:12345-192.168.202.53@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788658773.092050:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18048:x1875544001105408:12345-192.168.202.53@tcp:900:mount.lustre.0 Request processed in 294us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658773.092060:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:0.0:1788658773.095915:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658773.095954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658773.096018:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658773.096083:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001105536 00000100:00100000:1.0:1788658773.096092:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001105536 00000100:00100000:1.0:1788658773.096145:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:1.0:1788658773.096157:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18048:x1875544001105536:12345-192.168.202.53@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788658773.097073:0:22725:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 792us 00000100:00100000:2.0:1788658773.103282:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001105152 00000100:00100000:2.0:1788658773.103302:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001105152 00000100:00100000:2.0:1788658773.103372:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001105280 00000100:00100000:2.0:1788658773.103376:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001105280 00000100:00100000:2.0:1788658773.103425:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1788658773.103437:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1875544001105152:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788658773.103486:0:24227:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd@192.168.202.53@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1788658773.103530:0:24227:0:(genops.c:1385:class_connect()) connect: client 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd, cookie 0x48e67cc629c7079b 00002000:00100000:2.0:1788658773.103546:0:24227:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd/ffff8a1ebdea3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788658773.103559:0:24227:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788658773.103954:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1788658773.103963:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1875544001105280:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788658773.103984:0:24225:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd@192.168.202.53@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:3.0:1788658773.104007:0:24225:0:(genops.c:1385:class_connect()) connect: client 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd, cookie 0x48e67cc629c707a2 00002000:00100000:3.0:1788658773.104013:0:24225:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd/ffff8a1ec1217000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788658773.104032:0:24225:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788658773.104210:0:24225:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:2.0:1788658773.104305:0:24227:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788658773.104347:0:24227:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdea2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658773.104433:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:2395:x1875544001105152:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 997us (8476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.104443:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00080000:3.0:1788658773.106320:0:24225:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1215000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658773.106417:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:2395:x1875544001105280:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 2447us (10389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658773.106428:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000004:00200000:2.0:1788658773.121448:0:22725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788658773.121690:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18048:x1875544001105536:12345-192.168.202.53@tcp:33:mount.lustre.0 Request processed in 25527us (25778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.121749:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00010000:00010000:3.0:1788658773.182885:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658773.238527:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658773.238616:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001105664 00000100:00100000:0.0:1788658773.238628:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001105664 00000100:00100000:0.0:1788658773.238734:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:0.0:1788658773.238744:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18094:x1875544001105664:12345-192.168.202.53@tcp:101:mkdir.0 00010000:00010000:0.0:1788658773.238768:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658773.240067:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c707a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccd1b expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658773.240177:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c707b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658773.240191:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c707b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658773.240206:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c707b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658773.240287:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788658773.240293:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658773.240353:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c707b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658773.240390:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c707a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd1b expref: 8 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658773.240413:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c707b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd1b expref: 7 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658773.240423:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb24bbe00) 00010000:00010000:0.0:1788658773.240427:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658773.240431:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf603200, rc 0) 00000100:00100000:0.0:1788658773.240525:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:18094:x1875544001105664:12345-192.168.202.53@tcp:101:mkdir.0 Request processed in 1779us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658773.240536:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:3.0:1788658773.951149:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025338624:0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.951263:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658773.951295:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025338496:0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.951359:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025339136:0@lo:400:kworker.0 00000100:00100000:2.0:1788658773.951387:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658773.951572:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025338624 00000100:00100000:1.0:1788658773.951581:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025338624 00000100:00100000:1.0:1788658773.951634:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788658773.951643:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025338624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.951993:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658773.952012:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025339648:0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.952042:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658773.952069:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d823a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025340160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658773.952225:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025338752:0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.952264:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658773.952288:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025339264:0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.952311:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658773.952327:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025339776:0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.952347:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658773.952380:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788658773.952388:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025338880:0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.952409:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658773.952448:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025339392:0@lo:400:kworker.0 00000100:00100000:2.0:1788658773.952595:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025339008:0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.952631:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658773.952668:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025339904:0@lo:400:kworker.0 00000100:00100000:2.0:1788658773.952677:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658773.952745:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025339520:0@lo:400:kworker.0 00000100:00100000:2.0:1788658773.952775:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658773.952790:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025340032:0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.952802:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658773.952836:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658773.952900:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025338752 00000100:00100000:0.0:1788658773.952908:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025338752 00000100:00100000:0.0:1788658773.952975:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025339264 00000100:00100000:0.0:1788658773.952979:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025339264 00000100:00100000:0.0:1788658773.953002:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025338880 00000100:00100000:0.0:1788658773.953006:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025338880 00000100:00100000:0.0:1788658773.953024:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025339392 00000100:00100000:0.0:1788658773.953027:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025339392 00000100:00100000:2.0:1788658773.953035:0:22728:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788658773.953047:0:22728:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788658773.953052:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658773.953067:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025338752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658773.953099:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658773.953116:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025339264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.953151:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025338752:12345-0@lo:400:kworker.0 Request processed in 85us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658773.953163:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658773.953194:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025339264:12345-0@lo:400:kworker.0 Request processed in 82us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658773.953202:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658773.953213:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658773.953220:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875544025338880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658773.953253:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658773.953267:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025339392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.953275:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875544025338880:12345-0@lo:400:kworker.0 Request processed in 61us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658773.953285:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658773.953316:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025339392:12345-0@lo:400:kworker.0 Request processed in 53us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.953323:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658773.953398:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025339648 00000100:00100000:2.0:1788658773.953404:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025339648 00000100:00100000:2.0:1788658773.953565:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025339776 00000100:00100000:2.0:1788658773.953569:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025339776 00000100:00100000:2.0:1788658773.953585:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025339008 00000100:00100000:2.0:1788658773.953587:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025339008 00000100:00100000:2.0:1788658773.953597:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025339520 00000100:00100000:2.0:1788658773.953600:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025339520 00000100:00100000:2.0:1788658773.953608:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025339904 00000100:00100000:2.0:1788658773.953610:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025339904 00000100:00100000:2.0:1788658773.953620:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025340032 00000100:00100000:2.0:1788658773.953623:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025340032 00000100:00100000:2.0:1788658773.953634:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788658773.953639:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025339648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658773.953671:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025339648:12345-0@lo:400:kworker.0 Request processed in 32us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.953677:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788658773.953687:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658773.953691:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025339776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.953778:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658773.953855:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025339648:0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.954031:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025339136 00000100:00100000:3.0:1788658773.954037:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025339136 00000100:00100000:3.0:1788658773.954197:0:25515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788658773.954207:0:25515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025339136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.954257:0:25515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025339136:12345-0@lo:400:kworker.0 Request processed in 52us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658773.954265:0:25515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788658773.954294:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025339136:0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.954349:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025340288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658773.954376:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025339776:12345-0@lo:400:kworker.0 Request processed in 681us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.954386:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658773.954406:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658773.954414:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025339008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.956102:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025340416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658773.956105:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025339008:12345-0@lo:400:kworker.0 Request processed in 1674us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.956127:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658773.956164:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658773.956186:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025339520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.956188:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788658773.956266:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658773.956267:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025339520:12345-0@lo:400:kworker.0 Request processed in 91us (3486us total) trans 0 rc 0/0 00000100:00080000:0.0:1788658773.956274:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658773.956279:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658773.956282:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658773.956290:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658773.956310:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658773.956320:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025339904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.956337:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025340160 00000100:00100000:0.0:1788658773.956348:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025340160 00000100:00100000:2.0:1788658773.956367:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025339904:12345-0@lo:400:kworker.0 Request processed in 49us (3566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.956373:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658773.956393:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658773.956403:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025340032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658773.956409:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025340416 00000100:00100000:0.0:1788658773.956416:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025340416 00000100:00100000:0.0:1788658773.956439:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658773.956447:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025340160:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658773.957363:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025340032:12345-0@lo:400:kworker.0 Request processed in 958us (4523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658773.957374:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658773.957784:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025339008:0@lo:400:kworker.0 00000100:00100000:2.0:1788658773.957802:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025339520:0@lo:400:kworker.0 00010000:00080000:2.0:1788658773.957815:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb1c99c00 x1875544025340032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658773.957826:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025340032:0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.958562:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658773.958634:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025338880:0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.958652:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025339392:0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.958670:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025339904:0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.958683:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025338752:0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.958697:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025339264:0@lo:400:kworker.0 00010000:00080000:3.0:1788658773.958730:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb1c9a680 x1875544025339776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658773.958742:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025339776:0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.958822:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025338496 00000100:00100000:3.0:1788658773.958830:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025338496 00000100:00100000:3.0:1788658773.958883:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788658773.958893:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:3647:x1875544025338496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658773.958971:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:3647:x1875544025338496:12345-0@lo:400:kworker.0 Request processed in 80us (7586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658773.958979:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788658773.959062:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788658773.959072:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788658773.959260:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025340288 00000100:00100000:3.0:1788658773.959265:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025340288 00000100:00100000:3.0:1788658773.959369:0:25516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658773.959377:0:25516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025340416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788658773.959400:0:25516:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788658773.959449:0:25516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025340416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (3267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658773.959455:0:25516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658773.959474:0:25516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658773.959480:0:25516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025340288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788658773.959490:0:25516:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788658773.959518:0:25516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025340288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658773.959524:0:25516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658773.959555:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025340288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658773.959603:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025340416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658773.960033:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025338496:0@lo:400:kworker.0 00002000:00000024:0.0:1788658773.960945:0:24230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788658773.961027:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025340160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4577us (7247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658773.961036:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658773.964370:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025338624:12345-0@lo:400:kworker.0 Request processed in 12712us (13094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658773.964392:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788658773.966161:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d823a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025340160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658773.966196:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025338624:0@lo:400:kworker.0 00010000:00010000:3.0:1788658774.207022:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788658774.982130:0:25042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd 00000001:00080000:1.0:1788658774.982153:0:25042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:00100000:2.0:1788658774.982828:0:24222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd 00010000:00010000:1.0:1788658775.233609:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658775.245107:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658775.245451:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001105792 00000100:00100000:2.0:1788658775.245462:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001105792 00000100:00100000:2.0:1788658775.245540:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1788658775.245552:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:18146:x1875544001105792:12345-192.168.202.53@tcp:41:lfs.0 00000004:00000024:2.0:1788658775.245596:0:22724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788658775.245778:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:18146:x1875544001105792:12345-192.168.202.53@tcp:41:lfs.0 Request processed in 227us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658775.245786:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00080000:0.0:1788658775.245920:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658775.248837:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.248937:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001105920 00000100:00100000:3.0:1788658775.248946:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001105920 00000100:00100000:3.0:1788658775.249024:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:3.0:1788658775.249036:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18146:x1875544001105920:12345-192.168.202.53@tcp:41:lfs.0 00000004:00000024:3.0:1788658775.249080:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788658775.249195:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18146:x1875544001105920:12345-192.168.202.53@tcp:41:lfs.0 Request processed in 161us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658775.249203:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00080000:0.0:1788658775.249351:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788658775.253935:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.254028:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001106048 00000100:00100000:3.0:1788658775.254038:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001106048 00000100:00100000:3.0:1788658775.254115:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:3.0:1788658775.254127:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:18146:x1875544001106048:12345-192.168.202.53@tcp:13:lfs.0 00002000:00000024:3.0:1788658775.254186:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788658775.254347:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:18146:x1875544001106048:12345-192.168.202.53@tcp:13:lfs.0 Request processed in 222us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658775.254356:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00080000:0.0:1788658775.254629:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658775.264060:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658775.264170:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001106176 00000100:00100000:0.0:1788658775.264180:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001106176 00000100:00100000:0.0:1788658775.264274:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:0.0:1788658775.264286:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:18146:x1875544001106176:12345-192.168.202.53@tcp:13:lfs.0 00002000:00000024:0.0:1788658775.264334:0:24230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788658775.264427:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:18146:x1875544001106176:12345-192.168.202.53@tcp:13:lfs.0 Request processed in 143us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658775.264434:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00080000:2.0:1788658775.265014:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658775.394465:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.394552:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001106304 00000100:00100000:3.0:1788658775.394562:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001106304 00000100:00100000:3.0:1788658775.394623:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 131 00000100:00100000:3.0:1788658775.394633:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+10:18180:x1875544001106304:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788658775.394653:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658775.394672:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a0c00/0x48e67cc629c707b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccd22 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.394740:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a0c00/0x48e67cc629c707b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd22 expref: 11 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.394771:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a0c00/0x48e67cc629c707b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd22 expref: 11 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.394780:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0c00, rc 0) 00000100:00100000:3.0:1788658775.394839:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+11:18180:x1875544001106304:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 208us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658775.394845:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 131 00000100:00100000:1.0:1788658775.398985:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.399154:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001106432 00000100:00100000:3.0:1788658775.399163:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001106432 00000100:00100000:3.0:1788658775.399289:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:3.0:1788658775.399300:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+11:18180:x1875544001106432:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788658775.399477:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+11:18180:x1875544001106432:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 178us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658775.399485:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:1.0:1788658775.401647:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658775.401788:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001106560 00000100:00100000:0.0:1788658775.401798:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001106560 00000100:00100000:0.0:1788658775.401853:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 133 00000100:00100000:0.0:1788658775.401863:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+11:18180:x1875544001106560:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788658775.402115:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+11:18180:x1875544001106560:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 252us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658775.402133:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 133 00000100:00100000:1.0:1788658775.409598:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.412078:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001106688 00000100:00100000:3.0:1788658775.412096:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001106688 00000100:00100000:3.0:1788658775.412228:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 134 00000100:00100000:3.0:1788658775.412249:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+11:18184:x1875544001106688:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788658775.412459:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+11:18184:x1875544001106688:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 221us (2872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658775.412469:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 134 00000100:00100000:1.0:1788658775.441874:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658775.442045:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001106816 00000100:00100000:0.0:1788658775.442056:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001106816 00000100:00100000:0.0:1788658775.442119:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 135 00000100:00100000:0.0:1788658775.442130:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+11:18184:x1875544001106816:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658775.443106:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+11:18184:x1875544001106816:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 973us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658775.443115:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 135 00000100:00100000:1.0:1788658775.452407:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.452750:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001106944 00000100:00100000:3.0:1788658775.452761:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001106944 00000100:00100000:3.0:1788658775.452823:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 136 00000100:00100000:3.0:1788658775.452834:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+11:18184:x1875544001106944:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788658775.453014:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+11:18184:x1875544001106944:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 181us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658775.453022:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 136 00000100:00100000:1.0:1788658775.458856:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658775.459046:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001107072 00000100:00100000:2.0:1788658775.459058:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001107072 00000100:00100000:2.0:1788658775.459118:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 137 00000100:00100000:2.0:1788658775.459128:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+11:18180:x1875544001107072:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658775.459146:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658775.459164:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c707be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccd53 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658775.459210:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c707be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd53 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658775.459222:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c707be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd53 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658775.459232:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d0a00, rc 0) 00000100:00100000:2.0:1788658775.459483:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+12:18180:x1875544001107072:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 355us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658775.459489:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 137 00000100:00100000:1.0:1788658775.462274:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658775.462400:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001107200 00000100:00100000:0.0:1788658775.462410:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001107200 00000100:00100000:0.0:1788658775.462467:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 138 00000100:00100000:0.0:1788658775.462478:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+12:18180:x1875544001107200:12345-192.168.202.53@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788658775.462503:0:22715:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788658775.462530:0:22715:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788658775.462535:0:22715:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788658775.462538:0:22715:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788658775.462540:0:22715:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788658775.462543:0:22715:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788658775.465115:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+12:18180:x1875544001107200:12345-192.168.202.53@tcp:256:mount.lustre.0 Request processed in 2627us (2840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658775.465130:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 138 00000100:00100000:1.0:1788658775.471871:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.472373:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001107328 00000100:00100000:3.0:1788658775.472384:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001107328 00000100:00100000:3.0:1788658775.472445:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 139 00000100:00100000:3.0:1788658775.472456:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+12:18180:x1875544001107328:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788658775.472473:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658775.472492:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c707c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccd5a expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.472523:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c707c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd5a expref: 13 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.472534:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c707c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd5a expref: 13 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.472544:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1600, rc 0) 00000100:00100000:3.0:1788658775.472606:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+13:18180:x1875544001107328:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 150us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658775.472613:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 139 00000100:00100000:1.0:1788658775.477955:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658775.478614:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001107456 00000100:00100000:0.0:1788658775.478626:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001107456 00000100:00100000:0.0:1788658775.478740:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 140 00000100:00100000:0.0:1788658775.478753:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+13:18180:x1875544001107456:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788658775.478946:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+13:18180:x1875544001107456:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 195us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658775.478954:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 140 00000100:00100000:1.0:1788658775.482897:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.483046:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001107584 00000100:00100000:3.0:1788658775.483057:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001107584 00000100:00100000:3.0:1788658775.483124:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 141 00000100:00100000:3.0:1788658775.483135:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+13:18180:x1875544001107584:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788658775.483305:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+13:18180:x1875544001107584:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 170us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658775.483320:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 141 00000100:00100000:1.0:1788658775.498773:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658775.498906:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001107712 00000100:00100000:2.0:1788658775.498917:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001107712 00000100:00100000:2.0:1788658775.498977:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 142 00000100:00100000:2.0:1788658775.498989:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+13:18188:x1875544001107712:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658775.499155:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+13:18188:x1875544001107712:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 167us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658775.499169:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 142 00000100:00100000:1.0:1788658775.516246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658775.516390:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001107840 00000100:00100000:0.0:1788658775.516400:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001107840 00000100:00100000:0.0:1788658775.516461:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 143 00000100:00100000:0.0:1788658775.516472:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+13:18188:x1875544001107840:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658775.516630:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+13:18188:x1875544001107840:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 158us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658775.516639:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 143 00000040:00080000:0.0:1788658775.551646:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788658775.556049:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658775.556198:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.579009:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001107968 00000100:00100000:3.0:1788658775.579027:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001107968 00000100:00100000:2.0:1788658775.580103:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001108224 00000100:00100000:2.0:1788658775.580115:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001108224 00000100:00100000:2.0:1788658775.580139:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1788658775.580148:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1875544001107968:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788658775.580183:0:22722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7102ec86-86cd-4996-be3b-185f85f30890@192.168.202.53@tcp t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:2.0:1788658775.580223:0:22722:0:(genops.c:1385:class_connect()) connect: client 7102ec86-86cd-4996-be3b-185f85f30890, cookie 0x48e67cc629c707cc 00000004:00100000:2.0:1788658775.580249:0:22722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788658775.580342:0:22722:0:(import.c:65:import_set_state_nolock()) ffff8a1eb4f91800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658775.580445:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7102ec86-86cd-4996-be3b-185f85f30890+6:2395:x1875544001107968:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 296us (24404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658775.580453:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1788658775.580473:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:2.0:1788658775.580479:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1875544001108224:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788658775.580495:0:22722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 7102ec86-86cd-4996-be3b-185f85f30890@192.168.202.53@tcp t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:2.0:1788658775.580517:0:22722:0:(genops.c:1385:class_connect()) connect: client 7102ec86-86cd-4996-be3b-185f85f30890, cookie 0x48e67cc629c707d3 00000004:00100000:2.0:1788658775.580531:0:22722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788658775.580576:0:22722:0:(import.c:65:import_set_state_nolock()) ffff8a1eb4f97000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658775.580600:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7102ec86-86cd-4996-be3b-185f85f30890+6:2395:x1875544001108224:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 121us (24404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658775.580607:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:2.0:1788658775.583910:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.584510:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001108480 00000100:00100000:3.0:1788658775.584523:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001108480 00000100:00100000:3.0:1788658775.584605:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:3.0:1788658775.584615:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7102ec86-86cd-4996-be3b-185f85f30890+6:18180:x1875544001108480:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788658775.584648:0:22722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00080000:2.0:1788658775.584933:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658775.585069:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7102ec86-86cd-4996-be3b-185f85f30890+6:18180:x1875544001108480:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 454us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658775.585078:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1788658775.585913:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658775.586059:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.586848:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001108352 00000100:00100000:3.0:1788658775.586859:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001108352 00000100:00100000:3.0:1788658775.586903:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001108096 00000100:00100000:3.0:1788658775.586906:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001108096 00000100:00100000:0.0:1788658775.587867:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:0.0:1788658775.587887:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:0:x1875544001108352:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788658775.587920:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788658775.588015:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:0:x1875544001108352:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 135us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658775.588024:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00080000:2.0:1788658775.594114:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658775.596697:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:2.0:1788658775.596890:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7102ec86-86cd-4996-be3b-185f85f30890+6:0:x1875544001108096:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788658775.596930:0:22724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788658775.597019:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7102ec86-86cd-4996-be3b-185f85f30890+6:0:x1875544001108096:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 137us (10958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658775.597026:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:1.0:1788658775.597165:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.598125:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001108608 00000100:00100000:3.0:1788658775.598152:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001108608 00000100:00100000:3.0:1788658775.598224:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:3.0:1788658775.598234:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:18180:x1875544001108608:12345-192.168.202.53@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788658775.598413:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:18180:x1875544001108608:12345-192.168.202.53@tcp:40:mount.lustre.0 Request processed in 179us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658775.598420:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:1.0:1788658775.607414:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658775.607535:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001108736 00000100:00100000:2.0:1788658775.607545:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001108736 00000100:00100000:2.0:1788658775.607604:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:2.0:1788658775.607613:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2395:x1875544001108736:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788658775.607648:0:24896:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7102ec86-86cd-4996-be3b-185f85f30890@192.168.202.53@tcp t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:2.0:1788658775.607699:0:24896:0:(genops.c:1385:class_connect()) connect: client 7102ec86-86cd-4996-be3b-185f85f30890, cookie 0x48e67cc629c707da 00002000:00100000:2.0:1788658775.607752:0:24896:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7102ec86-86cd-4996-be3b-185f85f30890/ffff8a1eb4f90800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788658775.607765:0:24896:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788658775.607843:0:24896:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788658775.607877:0:24896:0:(import.c:65:import_set_state_nolock()) ffff8a1eb4f92000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658775.607957:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7102ec86-86cd-4996-be3b-185f85f30890+6:2395:x1875544001108736:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 342us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658775.607965:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1788658775.610645:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658775.610945:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001108992 00000100:00100000:2.0:1788658775.610959:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001108992 00000100:00100000:2.0:1788658775.611052:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1788658775.611065:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7102ec86-86cd-4996-be3b-185f85f30890+6:18180:x1875544001108992:12345-192.168.202.53@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788658775.611192:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7102ec86-86cd-4996-be3b-185f85f30890+6:18180:x1875544001108992:12345-192.168.202.53@tcp:900:mount.lustre.0 Request processed in 130us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658775.611220:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:1.0:1788658775.616697:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658775.617119:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001108864 00000100:00100000:0.0:1788658775.617135:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001108864 00000100:00100000:0.0:1788658775.617200:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:0.0:1788658775.617231:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1875544001108864:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788658775.617291:0:24228:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7102ec86-86cd-4996-be3b-185f85f30890@192.168.202.53@tcp t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:0.0:1788658775.617334:0:24228:0:(genops.c:1385:class_connect()) connect: client 7102ec86-86cd-4996-be3b-185f85f30890, cookie 0x48e67cc629c707e1 00002000:00100000:0.0:1788658775.617350:0:24228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7102ec86-86cd-4996-be3b-185f85f30890/ffff8a1d84c4c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658775.617363:0:24228:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658775.617483:0:24228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788658775.617528:0:24228:0:(import.c:65:import_set_state_nolock()) ffff8a1d84c4e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658775.617624:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7102ec86-86cd-4996-be3b-185f85f30890+6:2395:x1875544001108864:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 393us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658775.617633:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:0.0:1788658775.620510:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.620844:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001109120 00000100:00100000:3.0:1788658775.620859:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001109120 00000100:00100000:0.0:1788658775.621297:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:0.0:1788658775.621312:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:18180:x1875544001109120:12345-192.168.202.53@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788658775.621448:0:22726:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788658775.621559:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:18180:x1875544001109120:12345-192.168.202.53@tcp:33:mount.lustre.0 Request processed in 251us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658775.621568:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:2.0:1788658775.724815:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658775.724990:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001109248 00000100:00100000:3.0:1788658775.725002:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001109248 00000100:00100000:3.0:1788658775.725076:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1788658775.725101:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:18211:x1875544001109248:12345-192.168.202.53@tcp:101:mkdir.0 00010000:00010000:3.0:1788658775.725137:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658775.725165:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c707e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccd8b expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.725238:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.725252:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.725263:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658775.725314:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788658775.725316:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658775.725336:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.725360:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c707e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd8b expref: 8 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.725375:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd8b expref: 7 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658775.725404:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb24bbe00) 00010000:00010000:3.0:1788658775.725408:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658775.725413:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0600, rc 0) 00000100:00100000:3.0:1788658775.725544:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7102ec86-86cd-4996-be3b-185f85f30890+7:18211:x1875544001109248:12345-192.168.202.53@tcp:101:mkdir.0 Request processed in 444us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658775.725557:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00010000:00010000:3.0:1788658776.254923:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658777.023934:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658777.023964:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025340544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658777.024060:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658777.024146:0:25516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025340544 00000100:00100000:1.0:1788658777.024155:0:25516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025340544 00000100:00100000:1.0:1788658777.024233:0:25516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658777.024244:0:25516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025340544:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788658777.024358:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788658777.024441:0:25516:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788658777.024691:0:25516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025340544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 448us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658777.024700:0:25516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658777.024822:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025340544:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788658777.278965:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658777.536591:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658777.536626:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025340672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658777.536824:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658777.536881:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658777.536892:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025340800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658777.536919:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658777.536973:0:25515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025340672 00000100:00100000:3.0:1788658777.536987:0:25515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025340672 00000100:00100000:3.0:1788658777.537037:0:25515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025340800 00000100:00100000:3.0:1788658777.537040:0:25515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025340800 00000100:00100000:3.0:1788658777.537060:0:25515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788658777.537069:0:25515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025340672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658777.537114:0:25515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788658777.537175:0:25515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025340672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658777.537183:0:25515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788658777.537204:0:25515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788658777.537210:0:25515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025340800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658777.537228:0:25515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788658777.537259:0:25515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025340800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658777.537266:0:25515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788658777.537308:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025340800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658777.537362:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025340672:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788658778.303437:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658778.367641:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1788658778.565665:0:22702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7102ec86-86cd-4996-be3b-185f85f30890 00000001:00100000:1.0:1788658778.565685:0:22702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd 00000001:00100000:0.0:1788658778.572269:0:23455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7102ec86-86cd-4996-be3b-185f85f30890 00000001:00100000:0.0:1788658778.572286:0:23455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd 00000001:02000400:1.0:1788658778.880433:0:25602:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788658779.072966:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025340928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658779.073068:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658779.073199:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658779.073216:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025341056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658779.073248:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658779.073286:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025340928 00000100:00100000:0.0:1788658779.073294:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025340928 00000100:00100000:0.0:1788658779.073358:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025341056 00000100:00100000:0.0:1788658779.073360:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025341056 00000100:00100000:0.0:1788658779.073386:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658779.073398:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025340928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658779.073437:0:24230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788658779.073553:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025341440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658779.073580:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658779.075009:0:25516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025341440 00000100:00100000:1.0:1788658779.075020:0:25516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025341440 00000100:00100000:1.0:1788658779.075065:0:25516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658779.075075:0:25516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025341056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658779.075108:0:25516:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788658779.075176:0:25516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025341056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658779.075183:0:25516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658779.075204:0:25516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658779.075210:0:25516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025341440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658779.075219:0:25516:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788658779.075258:0:25516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025341440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658779.075292:0:25516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658779.075324:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025341312:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.075368:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658779.076127:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025341824:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.076168:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658779.076194:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025342336:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.077896:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658779.078032:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788658779.078055:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025341952:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.078146:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658779.078180:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025342464:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.078207:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658779.078556:0:25515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025341312 00000100:00100000:1.0:1788658779.078571:0:25515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025341312 00000100:00100000:1.0:1788658779.079914:0:25515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788658779.079937:0:25515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025341312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.080050:0:25515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025341312:12345-0@lo:400:kworker.0 Request processed in 125us (4681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658779.080057:0:25515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788658779.080095:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025342336 00000100:00100000:1.0:1788658779.080103:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025342336 00000100:00100000:1.0:1788658779.080134:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025341952 00000100:00100000:1.0:1788658779.080137:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025341952 00000100:00100000:1.0:1788658779.080149:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025342464 00000100:00100000:1.0:1788658779.080151:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025342464 00000100:00100000:1.0:1788658779.080162:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658779.080184:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025342336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.080214:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025342336:12345-0@lo:400:kworker.0 Request processed in 32us (3992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658779.080220:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658779.080244:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788658779.080249:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025341952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.081458:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025341952:12345-0@lo:400:kworker.0 Request processed in 1200us (3303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658779.081471:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788658779.081507:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788658779.081520:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025342464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.081594:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025342464:12345-0@lo:400:kworker.0 Request processed in 82us (3387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658779.081599:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788658779.081663:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025341952:0@lo:400:kworker.0 00010000:00080000:1.0:1788658779.081677:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb1c9a680 x1875544025342464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658779.081685:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025342464:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.081696:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025341312:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.081725:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025342336:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.083943:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025341184:0@lo:400:kworker.0 00000100:00100000:3.0:1788658779.084074:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025341568:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.084091:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658779.084114:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658779.084145:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025342080:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.084145:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025341696:0@lo:400:kworker.0 00000100:00100000:3.0:1788658779.084169:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658779.084191:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658779.084213:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025341824 00000100:00100000:1.0:1788658779.084215:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025342208:0@lo:400:kworker.0 00000100:00100000:3.0:1788658779.084222:0:25305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025341824 00000100:00100000:1.0:1788658779.084249:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658779.084289:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658779.084299:0:25305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025341824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.084307:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025341056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658779.084334:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025341568 00000100:00100000:1.0:1788658779.084337:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025341568 00000100:00100000:1.0:1788658779.084358:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025342080 00000100:00100000:3.0:1788658779.084360:0:25305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025341824:12345-0@lo:400:kworker.0 Request processed in 63us (8192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658779.084361:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025342080 00000100:00100000:3.0:1788658779.084368:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658779.084375:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025342208 00000100:00100000:1.0:1788658779.084377:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025342208 00000100:00100000:1.0:1788658779.084390:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788658779.084393:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025341184 00000100:00100000:3.0:1788658779.084396:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025341184 00000100:00100000:3.0:1788658779.084424:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788658779.084431:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:3648:x1875544025341184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658779.084466:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:3648:x1875544025341184:12345-0@lo:400:kworker.0 Request processed in 36us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658779.084472:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788658779.084639:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025340928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11241us (11569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658779.084651:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788658779.084682:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658779.084689:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658779.084692:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658779.084695:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658779.084738:0:22724:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788658779.084749:0:22724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788658779.084884:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788658779.084891:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025342080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658779.084930:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025342080:12345-0@lo:400:kworker.0 Request processed in 41us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658779.084937:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788658779.084950:0:22724:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788658779.084958:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788658779.084965:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025342208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658779.085007:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025342208:12345-0@lo:400:kworker.0 Request processed in 42us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658779.085025:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788658779.085279:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025342080:0@lo:400:kworker.0 00000100:00100000:3.0:1788658779.085334:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025340928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658779.085363:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788658779.085380:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025341440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658779.086020:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025341568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.086103:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025341568:12345-0@lo:400:kworker.0 Request processed in 1706us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658779.086111:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658779.086147:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025341696 00000100:00100000:1.0:1788658779.086153:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025341696 00000100:00100000:1.0:1788658779.086190:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658779.086196:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025341696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.086228:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025341696:12345-0@lo:400:kworker.0 Request processed in 33us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658779.086234:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788658779.086538:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025341568:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.088507:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025341824:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.088590:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025341184:0@lo:400:kworker.0 00000100:00100000:1.0:1788658779.088607:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025341696:0@lo:400:kworker.0 00010000:00080000:1.0:1788658779.088640:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb1c98a80 x1875544025342208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658779.088652:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025342208:0@lo:400:kworker.0 00010000:00010000:3.0:1788658779.328293:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658780.350875:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658780.859688:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658780.859781:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658780.859806:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658780.859823:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658780.859854:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658780.859876:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658780.859897:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658780.859919:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658780.859957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658780.860122:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001109760 00000100:00100000:1.0:1788658780.860135:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001109760 00000100:00100000:1.0:1788658780.860216:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001110272 00000100:00100000:1.0:1788658780.860221:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001110272 00000100:00100000:1.0:1788658780.860236:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001109888 00000100:00100000:1.0:1788658780.860239:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001109888 00000100:00100000:1.0:1788658780.860252:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001110400 00000100:00100000:1.0:1788658780.860254:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001110400 00000100:00100000:1.0:1788658780.860270:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:1.0:1788658780.860282:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2397:x1875544001109760:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658780.860387:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2397:x1875544001109760:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 107us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658780.860395:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:1.0:1788658780.860415:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:1.0:1788658780.860421:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:2397:x1875544001110272:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658780.860457:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:2397:x1875544001110272:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 36us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658780.860464:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:1.0:1788658780.860476:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:1.0:1788658780.860483:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2397:x1875544001109888:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658780.860505:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2397:x1875544001109888:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658780.860511:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:1.0:1788658780.860522:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:1.0:1788658780.860528:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:2397:x1875544001110400:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658780.860548:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:2397:x1875544001110400:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 21us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658780.860554:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:1.0:1788658780.860576:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001109376 00000100:00100000:1.0:1788658780.860581:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001109376 00000100:00100000:1.0:1788658780.860609:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 145 00000100:00100000:1.0:1788658780.860616:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+13:2397:x1875544001109376:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658780.860640:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+13:2397:x1875544001109376:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658780.860646:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 145 00000100:00100000:1.0:1788658780.860676:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001109504 00000100:00100000:1.0:1788658780.860680:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001109504 00000100:00100000:1.0:1788658780.860728:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001110016 00000100:00100000:1.0:1788658780.860732:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001110016 00000100:00100000:0.0:1788658780.860907:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001109632 00000100:00100000:0.0:1788658780.860912:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001109632 00000100:00100000:0.0:1788658780.860946:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001110144 00000100:00100000:0.0:1788658780.860950:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001110144 00000100:00100000:0.0:1788658780.860967:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:0.0:1788658780.860974:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:2397:x1875544001109504:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658780.861120:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:2397:x1875544001109504:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 147us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658780.861126:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:0.0:1788658780.861140:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:0.0:1788658780.861146:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2397:x1875544001109632:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658780.861170:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2397:x1875544001109632:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658780.861176:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:0.0:1788658780.861190:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:0.0:1788658780.861197:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7102ec86-86cd-4996-be3b-185f85f30890+5:2397:x1875544001110144:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658780.861221:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7102ec86-86cd-4996-be3b-185f85f30890+5:2397:x1875544001110144:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658780.861226:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:1.0:1788658780.861489:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:1.0:1788658780.861497:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7102ec86-86cd-4996-be3b-185f85f30890+6:2397:x1875544001110016:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658780.861521:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7102ec86-86cd-4996-be3b-185f85f30890+6:2397:x1875544001110016:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658780.861526:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00080000:2.0:1788658780.863870:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658780.863881:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658780.863885:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658780.863889:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788658781.376441:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788658781.641517:0:24222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7102ec86-86cd-4996-be3b-185f85f30890 00000001:00100000:1.0:1788658781.641517:0:25042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7102ec86-86cd-4996-be3b-185f85f30890 00000100:00100000:2.0:1788658782.143110:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658782.143142:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025342592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658782.143235:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658782.143434:0:25516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025342592 00000100:00100000:0.0:1788658782.143446:0:25516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025342592 00000100:00100000:0.0:1788658782.143573:0:25516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788658782.143588:0:25516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025342592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658782.143628:0:25516:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788658782.143735:0:25516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025342592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658782.143744:0:25516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658782.143895:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025342592:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788658782.144022:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788658782.399988:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658782.662907:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025342720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658782.662982:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658782.663043:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025342720 00000100:00100000:3.0:1788658782.663052:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025342720 00000100:00100000:3.0:1788658782.663108:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658782.663119:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025342720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658782.663155:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788658782.663205:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025342720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658782.663212:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788658782.663222:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025342720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658782.663230:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658782.663239:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025342848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658782.663265:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658782.663361:0:25515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025342848 00000100:00100000:0.0:1788658782.663365:0:25515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025342848 00000100:00100000:0.0:1788658782.663399:0:25515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788658782.663407:0:25515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025342848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658782.663426:0:25515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788658782.663475:0:25515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025342848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658782.663481:0:25515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788658782.666956:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025342848:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1788658782.709013:0:25751:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde36dd140 20000000:00000080:3.0:1788658782.709032:0:25751:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1eb69f5c00 uarg=0000000000000000 20000000:01000000:3.0:1788658782.709087:0:25751:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788658782.709094:0:25751:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788658782.709099:0:25751:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788658782.709908:0:25752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788658782.710110:0:25751:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788658782.727087:0:25751:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788658782.727212:0:25751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727249:0:25751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c70453 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c7044c expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727256:0:25751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c7045a expref: 23 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727263:0:25751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c704a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70499 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727279:0:25751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c7053a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70533 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727288:0:25751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c70786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccea expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727317:0:25751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c707c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd5a expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727323:0:25751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727359:0:25751:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c707c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd5a expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727371:0:25751:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c707c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd5a expref: 12 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658782.727382:0:25751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025342976:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658782.727477:0:25751:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c70786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccea expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727484:0:25751:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c70786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccea expref: 12 pid: 22717 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658782.727492:0:25751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f52680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025343104:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658782.727523:0:25751:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c7053a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c70533 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727530:0:25751:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c7053a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c70533 expref: 23 pid: 22717 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658782.727537:0:25751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025343232:0@lo:104: 00000100:00100000:0.0:1788658782.727574:0:25751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658782.727629:0:25751:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c704a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c70499 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727646:0:25751:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c704a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c70499 expref: 23 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658782.727653:0:25751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025343360:0@lo:104: 00000100:00100000:0.0:1788658782.727676:0:25751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658782.727752:0:25751:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c7045a expref: 23 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727761:0:25751:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70461 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c7045a expref: 23 pid: 22715 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658782.727770:0:25751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f51880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025343488:0@lo:104: 00000100:00100000:0.0:1788658782.727792:0:25751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658782.727804:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025343232 00000100:00100000:2.0:1788658782.727812:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025343232 00010000:00010000:0.0:1788658782.727814:0:25751:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c70453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c7044c expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658782.727821:0:25751:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c70453 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c7044c expref: 23 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658782.727828:0:25751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025343616:0@lo:104: 00000100:00100000:0.0:1788658782.727847:0:25751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658782.727850:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025343360 00000100:00100000:2.0:1788658782.727852:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025343360 00000100:00100000:0.0:1788658782.727856:0:25751:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebce43600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658782.727862:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025343488 00000100:00100000:2.0:1788658782.727865:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025343488 00000100:00100000:2.0:1788658782.727873:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025343616 00000100:00100000:2.0:1788658782.727876:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025343616 00000100:00100000:2.0:1788658782.727903:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658782.727913:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+6:25751:x1875544025343232:12345-0@lo:104: 00010000:00010000:2.0:1788658782.728164:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.728496:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658782.728522:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+6:25751:x1875544025343232:12345-0@lo:104: Request processed in 610us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658782.728530:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658782.728552:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658782.728558:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+5:25751:x1875544025343360:12345-0@lo:104: 00010000:00010000:2.0:1788658782.728567:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.728616:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788658782.728621:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+5:25751:x1875544025343360:12345-0@lo:104: Request processed in 64us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658782.728627:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658782.728651:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658782.728657:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+4:25751:x1875544025343488:12345-0@lo:104: 00010000:00010000:2.0:1788658782.728665:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.728697:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788658782.728734:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+4:25751:x1875544025343488:12345-0@lo:104: Request processed in 46us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658782.728740:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658782.728753:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658782.728759:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:25751:x1875544025343616:12345-0@lo:104: 00010000:00010000:2.0:1788658782.728767:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.728803:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788658782.728813:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+3:25751:x1875544025343616:12345-0@lo:104: Request processed in 55us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658782.728819:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788658782.728840:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788658782.728847:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.728855:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391000 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:2.0:1788658782.728859:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.728869:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658782.728887:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658782.728894:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658782.729023:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788658782.729037:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729048:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390800 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658782.729053:0:25306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729065:0:25306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658782.729071:0:25751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025343232:0@lo:104: 10000000:00010000:3.0:1788658782.729077:0:25306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658782.729085:0:25751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025343360:0@lo:104: 10000000:01000000:3.0:1788658782.729088:0:25306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788658782.729100:0:25751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f51880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025343488:0@lo:104: 00000100:00100000:1.0:1788658782.729110:0:25751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025343616:0@lo:104: 00010000:00010000:3.0:1788658782.729136:0:25306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729146:0:25306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658782.729180:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729189:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c70499 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c704a0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729205:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658782.729209:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729215:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2800 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658782.729232:0:25306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729240:0:25306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658782.729245:0:25306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658782.729251:0:25306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658782.729266:0:25306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729271:0:25306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658782.729299:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729306:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2800/0x48e67cc629c7045a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70461 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729317:0:25306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658782.729320:0:25306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729325:0:25306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf602200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658782.729328:0:25306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.729335:0:25306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658782.729352:0:25306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658782.729358:0:25306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658782.729373:0:25306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658782.729612:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025343872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658782.729671:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658782.729742:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025343872 00000100:00100000:1.0:1788658782.729748:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025343872 00010000:00010000:1.0:1788658782.729772:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70461 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c7045a expref: 24 pid: 22715 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658782.729811:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658782.729820:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:3647:x1875544025343872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658782.729832:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658782.729839:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70461 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c7045a expref: 24 pid: 22715 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658782.729862:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c7045a expref: 24 pid: 22715 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658782.729889:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70461 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c7045a expref: 24 pid: 22715 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658782.729903:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658782.730193:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.730201:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658782.730221:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.730228:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391000/0x48e67cc629c70533 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c7053a expref: -99 pid: 25041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.730239:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658782.730241:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658782.730243:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658782.730364:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:3647:x1875544025343872:12345-0@lo:103:ldlm_bl.0 Request processed in 544us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658782.730372:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658782.730430:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025343872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658782.730447:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658782.730454:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025344128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658782.730483:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658782.730694:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025344128 00000100:00100000:1.0:1788658782.730699:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025344128 00010000:00010000:1.0:1788658782.730787:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c7053a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c70533 expref: 23 pid: 22717 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658782.730826:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658782.730834:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:3647:x1875544025344128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658782.730842:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658782.730847:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c7053a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c70533 expref: 23 pid: 22717 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658782.730855:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c7053a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c70533 expref: 23 pid: 22717 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658782.730866:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c7053a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c70533 expref: 23 pid: 22717 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658782.730876:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658782.730917:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:3647:x1875544025344128:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658782.730944:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788658782.731077:0:25306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658782.731095:0:25306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.731106:0:25306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602200/0x48e67cc629c7044c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c70453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.731128:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658782.731131:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658782.731133:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658782.731146:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658782.731166:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3650:1875544025343744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658782.731234:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658782.731339:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025343744 00000100:00100000:2.0:1788658782.731346:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025343744 00010000:00010000:2.0:1788658782.731373:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c704a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c70499 expref: 22 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658782.731376:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658782.731398:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658782.731407:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3650:1875544025344000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658782.731409:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:3650:x1875544025343744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658782.731429:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658782.731434:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c704a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c70499 expref: 22 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.731444:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c704a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c70499 expref: 22 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658782.731455:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658782.731459:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c704a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c70499 expref: 22 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.731476:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658782.731506:0:22707:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788658782.731517:0:22707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788658782.731695:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:3650:x1875544025343744:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658782.731727:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025344000 00000100:00100000:2.0:1788658782.731729:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658782.731737:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025344000 00010000:00010000:3.0:1788658782.731772:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c70453 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c7044c expref: 21 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658782.731786:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3650:1875544025343744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658782.731927:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658782.731938:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:3650:x1875544025344000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658782.731952:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658782.731957:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c70453 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c7044c expref: 21 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.731968:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c70453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c7044c expref: 21 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.731983:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c70453 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c7044c expref: 21 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.734965:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658782.735094:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3647:1875544025344128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658782.737859:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3650:1875544025344000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658782.739942:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:3650:x1875544025344000:12345-0@lo:103:ldlm_bl.0 Request processed in 5825us (6308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658782.739972:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658782.740157:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658782.740257:0:25751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025342976:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658782.740277:0:25751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f52680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25751:1875544025343104:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658782.740296:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00010000:00010000:2.0:1788658782.740338:0:25751:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658782.740343:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001110528 00000100:00100000:3.0:1788658782.740356:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001110528 00000100:00100000:2.0:1788658782.740387:0:25753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001110656 00000100:00100000:2.0:1788658782.740396:0:25753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001110656 00010000:00010000:3.0:1788658782.740408:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c707c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd5a expref: 14 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.740437:0:25753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c70786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccea expref: 14 pid: 22717 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658782.740452:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:3.0:1788658782.740465:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a253e119-3367-4bac-b369-351e630e7e49+14:2396:x1875544001110528:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658782.740487:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658782.740495:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c707c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd5a expref: 14 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.740524:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c707c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd5a expref: 14 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.740549:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c707c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd5a expref: 14 pid: 22714 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658782.740571:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658782.740657:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a253e119-3367-4bac-b369-351e630e7e49+13:2396:x1875544001110528:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 194us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658782.741201:0:25753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1788658782.741230:0:25753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a253e119-3367-4bac-b369-351e630e7e49+13:2396:x1875544001110656:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658782.741247:0:25753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658782.741254:0:25753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c70786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccea expref: 13 pid: 22717 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741268:0:25753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c70786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccea expref: 13 pid: 22717 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741287:0:25753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c70786 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcccea expref: 13 pid: 22717 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741305:0:25753:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741313:0:25753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741329:0:25753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741349:0:25753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741357:0:25753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741363:0:25753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741370:0:25753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf602400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658782.741374:0:25753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741382:0:25753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741397:0:25753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741408:0:25753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658782.741458:0:25753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a253e119-3367-4bac-b369-351e630e7e49+12:2396:x1875544001110656:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 246us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658782.741467:0:25753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00010000:00010000:2.0:1788658782.741496:0:25751:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741518:0:25751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658782.741526:0:25751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ebf602400/0x48e67cc629c707f6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658782.745216:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00010000:00010000:2.0:1788658783.423868:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788658783.998977:0:22719:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658783.998989:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1d823c0000 from 13 10000000:01000000:2.0:1788658783.998997:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658783.999069:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c707fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658783.999083:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c707fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658783.999097:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c707fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658783.999132:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658783.999241:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658783.999306:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb757a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658783.999570:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025344256 00000100:00100000:3.0:1788658783.999582:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025344256 00000100:00100000:3.0:1788658783.999664:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788658783.999675:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+20:22719:x1875544025344256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658783.999692:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658783.999736:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c70804 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c707fd expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658783.999769:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c70804 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c707fd expref: 21 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658783.999781:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c70804 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c707fd expref: 21 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658783.999793:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1600, rc 0) 00000100:00100000:3.0:1788658783.999868:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:22719:x1875544025344256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658783.999875:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788658784.000054:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658784.000073:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c707fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70804 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.000083:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c707fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70804 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658784.000181:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658784.000212:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658784.000314:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb757a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658784.000411:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025344384 00000100:00100000:1.0:1788658784.000416:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025344384 00000100:00100000:1.0:1788658784.000459:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788658784.000468:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:22719:x1875544025344384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658784.000627:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:22719:x1875544025344384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.000635:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788658784.001045:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658784.001094:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658784.001138:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658784.001172:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb757a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658784.001246:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025344512 00000100:00100000:0.0:1788658784.001261:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025344512 00000100:00100000:0.0:1788658784.001332:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788658784.001342:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:22719:x1875544025344512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658784.001525:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:22719:x1875544025344512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.001540:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788658784.002725:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788658784.013785:0:25765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788658784.017086:0:22719:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788658784.017131:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658784.017146:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c707fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70804 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.017160:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c707fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70804 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658784.017174:0:22719:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658784.017177:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1d83d59800 from 13 10000000:01000000:2.0:1788658784.017180:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658784.017306:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1c00/0x48e67cc629c7080b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.017317:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1c00/0x48e67cc629c7080b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.017332:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1c00/0x48e67cc629c7080b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658784.017491:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658784.017595:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658784.017726:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb757a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658784.018354:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025344640 00000100:00100000:1.0:1788658784.018375:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025344640 00000100:00100000:1.0:1788658784.018447:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788658784.018460:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+21:22719:x1875544025344640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658784.018477:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658784.018497:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70812 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c7080b expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.018530:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c7080b expref: 22 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.018556:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c70812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c7080b expref: 22 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.018568:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96a00, rc 0) 00000100:00100000:1.0:1788658784.018636:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:22719:x1875544025344640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.018643:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788658784.018992:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658784.019031:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1c00/0x48e67cc629c7080b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70812 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.019043:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1c00/0x48e67cc629c7080b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70812 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658784.019134:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658784.019169:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658784.019208:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb757a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658784.019391:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025344768 00000100:00100000:1.0:1788658784.019404:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025344768 00000100:00100000:1.0:1788658784.019450:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788658784.019458:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:22719:x1875544025344768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658784.019632:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:22719:x1875544025344768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.019640:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788658784.020026:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658784.020069:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658784.020129:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658784.020164:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb757a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658784.020756:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025344896 00000100:00100000:3.0:1788658784.020763:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025344896 00000100:00100000:3.0:1788658784.020818:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788658784.020836:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:22719:x1875544025344896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658784.020984:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:22719:x1875544025344896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658784.020992:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788658784.021279:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025344896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788658784.023459:0:25766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788658784.024443:0:22719:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788658784.024477:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658784.024492:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1c00/0x48e67cc629c7080b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70812 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.024507:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1c00/0x48e67cc629c7080b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70812 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658784.024521:0:22719:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788658784.024525:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ebdc0b000 from 13 10000000:01000000:3.0:1788658784.024528:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658784.024804:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1200/0x48e67cc629c70819 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.024815:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1200/0x48e67cc629c70819 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.024893:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1200/0x48e67cc629c70819 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658784.024926:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658784.025008:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658784.025112:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e859293c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658784.025153:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025345024 00000100:00100000:0.0:1788658784.025161:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025345024 00000100:00100000:0.0:1788658784.025252:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788658784.025262:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+22:22719:x1875544025345024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658784.025278:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658784.025292:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ebf603800/0x48e67cc629c70820 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70819 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.025321:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf603800/0x48e67cc629c70820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70819 expref: 23 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.025333:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ebf603800/0x48e67cc629c70820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70819 expref: 23 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.025342:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf603800, rc 0) 00000100:00100000:0.0:1788658784.025398:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:22719:x1875544025345024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.025406:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788658784.025481:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658784.025496:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1200/0x48e67cc629c70819 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70820 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.025506:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1200/0x48e67cc629c70819 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c70820 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658784.025583:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658784.025607:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658784.026048:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e859293c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658784.026157:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025345152 00000100:00100000:1.0:1788658784.026163:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025345152 00000100:00100000:1.0:1788658784.026192:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788658784.026199:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:22719:x1875544025345152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658784.026339:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:22719:x1875544025345152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.026346:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788658784.026480:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658784.026517:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658784.026803:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658784.026825:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e859293c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658784.027146:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025345280 00000100:00100000:0.0:1788658784.027154:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025345280 00000100:00100000:3.0:1788658784.027270:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788658784.027279:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:22719:x1875544025345280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658784.027398:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:22719:x1875544025345280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658784.027406:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788658784.027455:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788658784.031976:0:25767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788658784.033507:0:22719:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788658784.033649:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658784.033666:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1200/0x48e67cc629c70819 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70820 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.033683:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1200/0x48e67cc629c70819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c70820 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658784.033851:0:22719:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658784.033854:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1d810f6800 from 13 10000000:01000000:0.0:1788658784.033857:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658784.033920:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602400/0x48e67cc629c70827 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.033929:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602400/0x48e67cc629c70827 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.033941:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602400/0x48e67cc629c70827 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658784.033972:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658784.034057:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658784.034108:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebce433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658784.034641:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025345408 00000100:00100000:1.0:1788658784.034651:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025345408 00000100:00100000:1.0:1788658784.034723:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788658784.034733:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+23:22719:x1875544025345408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658784.034750:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658784.034768:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c7082e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c70827 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.034800:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c7082e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c70827 expref: 24 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.034812:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b97400/0x48e67cc629c7082e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c70827 expref: 24 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.034819:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97400, rc 0) 00000100:00100000:1.0:1788658784.034895:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:22719:x1875544025345408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.034903:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788658784.034928:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658784.034948:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602400/0x48e67cc629c70827 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7082e expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.034959:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602400/0x48e67cc629c70827 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c7082e expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658784.035138:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658784.035162:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658784.035188:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead888480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658784.035197:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025345536 00000100:00100000:3.0:1788658784.035202:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025345536 00000100:00100000:3.0:1788658784.035237:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788658784.035244:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:22719:x1875544025345536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658784.035461:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:22719:x1875544025345536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658784.035469:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788658784.036023:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658784.036065:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658784.036124:0:22719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658784.036196:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead888480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658784.036232:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025345664 00000100:00100000:3.0:1788658784.036237:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025345664 00000100:00100000:3.0:1788658784.036667:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788658784.036676:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:22719:x1875544025345664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658784.039124:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:22719:x1875544025345664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2436us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658784.039141:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788658784.039527:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:22719:1875544025345664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788658784.043101:0:25768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788658784.043603:0:22719:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788658784.043637:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658784.043653:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602400/0x48e67cc629c70827 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7082e expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.043666:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ebf602400/0x48e67cc629c70827 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c7082e expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658784.152434:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.152699:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001110784 00000100:00100000:2.0:1788658784.152738:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001110784 00000100:00100000:2.0:1788658784.152871:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:2.0:1788658784.152894:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:18680:x1875544001110784:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658784.152920:0:25613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658784.152953:0:25613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c70835 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccd92 expref: -99 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153039:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7083c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153078:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7083c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153094:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7083c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153113:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70843 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153120:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70843 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153126:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70843 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153242:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1600/0x48e67cc629c7084a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153250:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1600/0x48e67cc629c7084a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153258:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1600/0x48e67cc629c7084a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658784.153296:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788658784.153301:0:25613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658784.153352:0:25613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1600/0x48e67cc629c7084a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153365:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7083c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153393:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7083c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153401:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7083c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153407:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658784.153412:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7083c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153421:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7083c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153435:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb24bbe00) 00010000:00010000:2.0:1788658784.153437:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658784.153443:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7083c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153449:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7083c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153466:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70843 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153473:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70843 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153479:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70843 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153483:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658784.153492:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70843 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153498:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70843 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153506:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a1d83409e00) 00010000:00010000:2.0:1788658784.153509:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658784.153512:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70843 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153518:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70843 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153570:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c70835 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd92 expref: 8 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153587:0:25613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1600/0x48e67cc629c7084a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd92 expref: 7 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.153594:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1d83409900) 00010000:00010000:2.0:1788658784.153596:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658784.153598:0:25613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1600, rc 0) 00000100:00100000:2.0:1788658784.154158:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:18680:x1875544001110784:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 795us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658784.154181:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00080000:3.0:1788658784.154477:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658784.160273:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658784.160433:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001110912 00000100:00100000:1.0:1788658784.160447:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001110912 00000100:00100000:1.0:1788658784.160522:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:1.0:1788658784.160544:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:18680:x1875544001110912:12345-192.168.202.53@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788658784.160657:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:18680:x1875544001110912:12345-192.168.202.53@tcp:900:lhsmtool_posix.0 Request processed in 124us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.160665:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1788658784.165624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.165811:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001111168 00000100:00100000:2.0:1788658784.165824:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001111168 00000100:00100000:2.0:1788658784.165917:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:2.0:1788658784.165930:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:18680:x1875544001111168:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658784.165979:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658784.166007:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c70851 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccd99 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166112:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70858 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166130:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70858 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166145:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70858 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166162:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7085f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166183:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7085f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166192:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7085f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166332:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c70866 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166341:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c70866 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166349:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c70866 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658784.166360:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788658784.166557:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70858 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166567:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70858 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166573:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70858 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166579:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658784.166585:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70858 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166594:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70858 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166608:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1d83409900) 00010000:00010000:2.0:1788658784.166612:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658784.166618:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70858 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166624:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70858 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166643:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7085f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166649:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7085f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166655:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7085f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166670:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658784.166674:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7085f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166680:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7085f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166689:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a1d83409e00) 00010000:00010000:2.0:1788658784.166691:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658784.166694:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7085f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.166767:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c7085f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.171491:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c70851 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd99 expref: 10 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.171530:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c70866 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd99 expref: 9 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.171548:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83409200) 00010000:00010000:2.0:1788658784.171552:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658784.171556:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1200, rc 0) 00000100:00100000:2.0:1788658784.171662:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+9:18680:x1875544001111168:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 5732us (6057us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788658784.171672:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:0.0:1788658784.183361:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.183539:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001111296 00000100:00100000:2.0:1788658784.183568:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001111296 00000100:00100000:2.0:1788658784.183650:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:2.0:1788658784.183663:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+9:18680:x1875544001111296:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788658784.183855:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+9:18680:x1875544001111296:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 Request processed in 193us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658784.183871:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1788658784.189184:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.189658:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001111424 00000100:00100000:2.0:1788658784.189671:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001111424 00000100:00100000:2.0:1788658784.189810:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:2.0:1788658784.189823:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:18680:x1875544001111424:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788658784.190508:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658784.190999:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658784.191023:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025345792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658784.191104:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658784.191165:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025345792 00000100:00100000:0.0:1788658784.191171:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025345792 00000100:00100000:1.0:1788658784.191379:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025345920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658784.192614:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658784.192686:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025345920 00000100:00100000:1.0:1788658784.192695:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025345920 00000100:00100000:0.0:1788658784.193966:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658784.193981:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025345920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658784.194026:0:24230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788658784.194115:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025345920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.194122:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658784.194143:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788658784.194150:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025345792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658784.194168:0:24230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00080000:3.0:1788658784.194400:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658784.194406:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658784.194974:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025345920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658784.195077:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658784.195089:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025346048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658784.195144:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658784.197248:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025345792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3086us (6131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.197264:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788658784.197306:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025346048 00000100:00100000:0.0:1788658784.197315:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025346048 00000100:00100000:0.0:1788658784.197365:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788658784.197374:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025346048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658784.197419:0:24230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000004:00080000:2.0:1788658784.197876:0:22722:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7995us 00000100:00100000:0.0:1788658784.200072:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025346048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2687us (4916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.200087:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788658784.200157:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025346176:0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.200239:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658784.200310:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025345792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658784.200339:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658784.200355:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025346304:0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.200385:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658784.200419:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025346304 00000100:00100000:0.0:1788658784.200427:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025346304 00000100:00100000:0.0:1788658784.200471:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788658784.200481:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025346304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.200533:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025346304:12345-0@lo:400:kworker.0 Request processed in 55us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.200540:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788658784.200571:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025346304:0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.200594:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025346432:0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.200621:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658784.200828:0:25515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025346176 00000100:00100000:1.0:1788658784.200834:0:25515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025346176 00000100:00100000:1.0:1788658784.200862:0:25515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025346432 00000100:00100000:1.0:1788658784.200865:0:25515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025346432 00000100:00100000:1.0:1788658784.200879:0:25515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788658784.200886:0:25515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025346176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.200936:0:25515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025346176:12345-0@lo:400:kworker.0 Request processed in 51us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.200943:0:25515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788658784.200960:0:25515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658784.200966:0:25515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025346432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.200995:0:25515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025346432:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.201000:0:25515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658784.201122:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025346688:0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.201148:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658784.201167:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025347200:0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.201188:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658784.201211:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025346176:0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.201223:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658784.201228:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025346816:0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.201251:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658784.201286:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025346688 00000100:00100000:1.0:1788658784.201290:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025346688 00000100:00100000:1.0:1788658784.201310:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025347200 00000100:00100000:1.0:1788658784.201313:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025347200 00000100:00100000:1.0:1788658784.201329:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025346816 00000100:00100000:1.0:1788658784.201332:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025346816 00000100:00100000:1.0:1788658784.201345:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788658784.201351:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025346688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.201387:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025346688:12345-0@lo:400:kworker.0 Request processed in 35us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.201393:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788658784.201406:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788658784.201412:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025347200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.201438:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025347200:12345-0@lo:400:kworker.0 Request processed in 27us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.201444:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788658784.201454:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658784.201461:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025346816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.201486:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025346816:12345-0@lo:400:kworker.0 Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.201491:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658784.201513:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025346816:0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.201522:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025346688:0@lo:400:kworker.0 00010000:00080000:1.0:1788658784.201533:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb1c9a680 x1875544025347200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658784.201543:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025347200:0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.202083:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025346048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658784.202105:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025346944:0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.202138:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658784.202165:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025346432:0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.202190:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788658784.202197:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025346560:0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.202224:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658784.202246:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025347072:0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.202267:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658784.202298:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025346560 00000100:00100000:0.0:1788658784.202303:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025346560 00000100:00100000:0.0:1788658784.202343:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658784.202351:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025346560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.202412:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025346560:12345-0@lo:400:kworker.0 Request processed in 62us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.202419:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658784.202440:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025346944 00000100:00100000:0.0:1788658784.202444:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025346944 00000100:00100000:0.0:1788658784.202467:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025347072 00000100:00100000:0.0:1788658784.202471:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025347072 00000100:00100000:0.0:1788658784.202488:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788658784.202494:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025346944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658784.202523:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025346944:12345-0@lo:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.202529:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788658784.203094:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658784.203100:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658784.203103:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658784.203105:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658784.203271:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788658784.203286:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025347072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.203335:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025347072:12345-0@lo:400:kworker.0 Request processed in 54us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.203342:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788658784.203425:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025346560:0@lo:400:kworker.0 00000100:00100000:1.0:1788658784.203436:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025347072:0@lo:400:kworker.0 00010000:00080000:1.0:1788658784.203448:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb1c9ad80 x1875544025346944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658784.203459:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025346944:0@lo:400:kworker.0 00000100:00100000:2.0:1788658784.248111:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:18680:x1875544001111424:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 Request processed in 58275us (58934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658784.248129:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:3.0:1788658784.269851:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658784.270006:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001111552 00000100:00100000:1.0:1788658784.270019:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001111552 00000100:00100000:1.0:1788658784.270088:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:1.0:1788658784.270099:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+9:18686:x1875544001111552:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1788658784.270125:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658784.270155:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97600/0x48e67cc629c70874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccda0 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.270242:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97e00/0x48e67cc629c7087b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.270260:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97e00/0x48e67cc629c7087b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.270285:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97e00/0x48e67cc629c7087b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274734:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c70882 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274760:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c70882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274776:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c70882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274831:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97e00/0x48e67cc629c7087b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274838:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97e00/0x48e67cc629c7087b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274845:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97e00/0x48e67cc629c7087b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274851:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658784.274855:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97e00/0x48e67cc629c7087b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274863:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97e00/0x48e67cc629c7087b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274875:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb24bbe00) 00010000:00010000:1.0:1788658784.274878:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658784.274883:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97e00/0x48e67cc629c7087b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274889:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97e00/0x48e67cc629c7087b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274933:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c70882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274939:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c70882 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274945:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c70882 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274949:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658784.274952:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c70882 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274957:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c70882 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274965:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a1d83403300) 00010000:00010000:1.0:1788658784.274967:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658784.274969:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c70882 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.274975:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c70882 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.276667:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97600/0x48e67cc629c70874 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccda0 expref: 10 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.276689:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb24bbe00) 00010000:00010000:1.0:1788658784.276691:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658784.276736:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97600/0x48e67cc629c70874 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccda0 expref: 10 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.276754:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97600, rc 0) 00000100:00100000:1.0:1788658784.276839:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+9:18686:x1875544001111552:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 6740us (7000us total) trans 0 rc 301/301 00000100:00100000:1.0:1788658784.276848:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:2.0:1788658784.282983:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.283124:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001111680 00000100:00100000:0.0:1788658784.283142:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001111680 00000100:00100000:0.0:1788658784.283224:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:0.0:1788658784.283239:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+9:18686:x1875544001111680:12345-192.168.202.53@tcp:700:lfs.0 00000100:00100000:0.0:1788658784.283369:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+9:18686:x1875544001111680:12345-192.168.202.53@tcp:700:lfs.0 Request processed in 133us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.283378:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:0.0:1788658784.287586:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.287750:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001111936 00000100:00100000:2.0:1788658784.287779:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001111936 00000100:00100000:2.0:1788658784.287860:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:2.0:1788658784.287872:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+9:18686:x1875544001111936:12345-192.168.202.53@tcp:36:lfs.0 00010000:00010000:2.0:1788658784.288033:0:25613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658784.288066:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c707b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd1b expref: 9 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.288089:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb24bbe00) 00010000:00010000:2.0:1788658784.288095:0:25613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658784.288187:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.288374:0:25613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd8b expref: 5 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.288384:0:25613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.288428:0:25613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd8b expref: 5 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.288445:0:25613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd8b expref: 5 pid: 22723 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658784.288463:0:25613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25613:1875544025347328:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658784.288575:0:25613:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb757ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658784.292080:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.293216:0:25753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001112064 00000100:00100000:0.0:1788658784.293229:0:25753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001112064 00010000:00010000:0.0:1788658784.293306:0:25753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd8b expref: 6 pid: 22723 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658784.293340:0:25753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:0.0:1788658784.293348:0:25753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7102ec86-86cd-4996-be3b-185f85f30890+6:2397:x1875544001112064:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658784.293372:0:25753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658784.293379:0:25753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd8b expref: 6 pid: 22723 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.293395:0:25753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd8b expref: 6 pid: 22723 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.293423:0:25753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb24bbe00) 00010000:00010000:0.0:1788658784.293429:0:25753:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.293440:0:25753:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.293448:0:25753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.293474:0:25753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658784.293560:0:25753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7102ec86-86cd-4996-be3b-185f85f30890+6:2397:x1875544001112064:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 210us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.293569:0:25753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00080000:3.0:1788658784.293808:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788658784.296662:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c707ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccd8b expref: 5 pid: 22723 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658784.296692:0:25613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25613:1875544025347328:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658784.296747:0:25613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.296759:0:25613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.296764:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.296821:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.296837:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.296849:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309121:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309154:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309170:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658784.309193:0:25613:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b7e643e reply state 0000000037978e59 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309219:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309228:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a1e83ad6100) 00010000:00010000:3.0:1788658784.309231:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658784.309236:0:25613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788658784.309243:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788658784.309255:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309262:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309270:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309276:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658784.309281:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309302:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309315:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb24bbe00) 00010000:00010000:3.0:1788658784.309318:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658784.309322:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309329:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c70889 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658784.309354:0:25613:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b7e643e reply state 0000000037978e59 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309362:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.309368:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a1d83409e00) 00010000:00010000:3.0:1788658784.309371:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658784.309373:0:25613:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788658784.309511:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+10:18686:x1875544001111936:12345-192.168.202.53@tcp:36:lfs.0 Request processed in 21635us (21934us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788658784.309522:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:3.0:1788658784.365638:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.366096:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001112192 00000100:00100000:2.0:1788658784.366109:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001112192 00000100:00100000:2.0:1788658784.366178:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:2.0:1788658784.366188:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+10:18694:x1875544001112192:12345-192.168.202.53@tcp:101:lctl.0 00010000:00010000:2.0:1788658784.366218:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658784.366246:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7089e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccda7 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.366336:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c708a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.366350:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c708a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.366361:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c708a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658784.366416:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788658784.366430:0:22724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658784.366480:0:22724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c708a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.366528:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7089e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccda7 expref: 12 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.366549:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0000/0x48e67cc629c708a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccda7 expref: 11 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.366558:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83409a00) 00010000:00010000:2.0:1788658784.366562:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658784.366566:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d0000, rc 0) 00000100:00100000:2.0:1788658784.366767:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+11:18694:x1875544001112192:12345-192.168.202.53@tcp:101:lctl.0 Request processed in 579us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658784.366773:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:2.0:1788658784.382115:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.382306:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001112320 00000100:00100000:0.0:1788658784.382320:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001112320 00000100:00100000:0.0:1788658784.382552:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:0.0:1788658784.382565:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7102ec86-86cd-4996-be3b-185f85f30890+5:18695:x1875544001112320:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658784.382594:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658784.382622:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c708ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccdae expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.382770:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603a00/0x48e67cc629c708b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.382789:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603a00/0x48e67cc629c708b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.382804:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603a00/0x48e67cc629c708b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658784.382876:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788658784.382881:0:22722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658784.383084:0:22722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603a00/0x48e67cc629c708b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.383116:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c708ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdae expref: 7 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.383137:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603a00/0x48e67cc629c708b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdae expref: 6 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.383148:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83409a00) 00010000:00010000:0.0:1788658784.383151:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658784.383156:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf603a00, rc 0) 00000100:00100000:0.0:1788658784.383248:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7102ec86-86cd-4996-be3b-185f85f30890+6:18695:x1875544001112320:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 685us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.383257:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:0.0:1788658784.387100:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658784.387288:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001112448 00000100:00100000:1.0:1788658784.387323:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001112448 00000100:00100000:1.0:1788658784.387400:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:1.0:1788658784.387412:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7102ec86-86cd-4996-be3b-185f85f30890+6:18695:x1875544001112448:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1788658784.387761:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658784.387792:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c708ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccdb5 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.387886:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.387902:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.387917:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.387946:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671e00/0x48e67cc629c708c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.387955:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671e00/0x48e67cc629c708c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.387961:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671e00/0x48e67cc629c708c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388063:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670800/0x48e67cc629c708cf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388069:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670800/0x48e67cc629c708cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388074:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670800/0x48e67cc629c708cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658784.388115:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788658784.388117:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788658784.388142:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670800/0x48e67cc629c708cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388153:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388159:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388164:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388168:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658784.388172:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388178:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388187:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83409a00) 00010000:00010000:1.0:1788658784.388194:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658784.388199:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388204:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388229:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671e00/0x48e67cc629c708c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388233:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671e00/0x48e67cc629c708c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388237:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671e00/0x48e67cc629c708c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388240:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658784.388241:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671e00/0x48e67cc629c708c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388245:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671e00/0x48e67cc629c708c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388249:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a1d83409e00) 00010000:00010000:1.0:1788658784.388250:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658784.388252:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671e00/0x48e67cc629c708c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388255:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671e00/0x48e67cc629c708c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388279:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c708ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdb5 expref: 8 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388306:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670800/0x48e67cc629c708cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdb5 expref: 7 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.388312:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a1e83ad6100) 00010000:00010000:1.0:1788658784.388314:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658784.388315:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670800, rc 0) 00000100:00100000:1.0:1788658784.388380:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7102ec86-86cd-4996-be3b-185f85f30890+7:18695:x1875544001112448:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 971us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.388388:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:1.0:1788658784.390749:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.390836:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001112576 00000100:00100000:2.0:1788658784.390847:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001112576 00000100:00100000:2.0:1788658784.391004:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1788658784.391023:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7102ec86-86cd-4996-be3b-185f85f30890+5:18695:x1875544001112576:12345-192.168.202.53@tcp:900:lfs.0 00000100:00100000:2.0:1788658784.391118:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7102ec86-86cd-4996-be3b-185f85f30890+5:18695:x1875544001112576:12345-192.168.202.53@tcp:900:lfs.0 Request processed in 103us (414us total) trans 0 rc 0/0 00000100:00080000:3.0:1788658784.391163:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658784.396067:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1788658784.399026:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658784.399262:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001112832 00000100:00100000:3.0:1788658784.399274:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001112832 00000100:00100000:3.0:1788658784.399353:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:3.0:1788658784.399366:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7102ec86-86cd-4996-be3b-185f85f30890+7:18695:x1875544001112832:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658784.399414:0:25613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658784.399748:0:25613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c708d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccdbc expref: -99 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658784.399882:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788658784.400072:0:25613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c708d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdbc expref: 9 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.400086:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83409a00) 00010000:00010000:3.0:1788658784.400088:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658784.400093:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c708d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdbc expref: 9 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.400105:0:25613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0e00, rc 0) 00000100:00100000:3.0:1788658784.400170:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7102ec86-86cd-4996-be3b-185f85f30890+8:18695:x1875544001112832:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 806us (1159us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788658784.400178:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:3.0:1788658784.407405:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.407483:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001113088 00000100:00100000:2.0:1788658784.407497:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001113088 00000100:00100000:2.0:1788658784.407630:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:2.0:1788658784.407642:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7102ec86-86cd-4996-be3b-185f85f30890+8:18695:x1875544001113088:12345-192.168.202.53@tcp:36:lfs.0 00010000:00010000:2.0:1788658784.407789:0:22724:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658784.407839:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670800/0x48e67cc629c708cf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdb5 expref: 8 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.407866:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a1e83ad6100) 00010000:00010000:2.0:1788658784.407873:0:22724:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658784.407914:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.407940:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.407953:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658784.408229:0:22724:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093b5cd01 reply state 00000000d3fc1b4b transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.408243:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.408251:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a1e83ad6100) 00010000:00010000:2.0:1788658784.408254:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788658784.408257:0:22724:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788658784.408267:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788658784.408372:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7102ec86-86cd-4996-be3b-185f85f30890+9:18695:x1875544001113088:12345-192.168.202.53@tcp:36:lfs.0 Request processed in 730us (977us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788658784.408391:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:1.0:1788658784.413126:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.413270:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001113216 00000100:00100000:0.0:1788658784.413301:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001113216 00000100:00100000:0.0:1788658784.413379:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:0.0:1788658784.413392:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7102ec86-86cd-4996-be3b-185f85f30890+9:18695:x1875544001113216:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658784.413425:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658784.413453:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c708eb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccdc3 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.413589:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.413608:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.413623:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658784.413662:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788658784.413665:0:22722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658784.413691:0:22722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.413808:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c708eb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdc3 expref: 11 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.414655:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdc3 expref: 10 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.414668:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a1e83ad6100) 00010000:00010000:0.0:1788658784.414671:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658784.414676:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf602a00, rc 0) 00000100:00100000:0.0:1788658784.417089:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7102ec86-86cd-4996-be3b-185f85f30890+10:18695:x1875544001113216:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 3683us (3961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.417103:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:3.0:1788658784.433421:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.433763:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001113344 00000100:00100000:0.0:1788658784.433777:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001113344 00000100:00100000:0.0:1788658784.433864:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:0.0:1788658784.433877:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7102ec86-86cd-4996-be3b-185f85f30890+10:18695:x1875544001113344:12345-192.168.202.53@tcp:37:lfs.0 00000100:00100000:0.0:1788658784.439317:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7102ec86-86cd-4996-be3b-185f85f30890+10:18695:x1875544001113344:12345-192.168.202.53@tcp:37:lfs.0 Request processed in 5425us (5895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.439333:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:1.0:1788658784.442121:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658784.442211:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001113600 00000100:00100000:3.0:1788658784.442226:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001113600 00000100:00100000:3.0:1788658784.442297:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:3.0:1788658784.442310:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7102ec86-86cd-4996-be3b-185f85f30890+10:18695:x1875544001113600:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:3.0:1788658784.442605:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7102ec86-86cd-4996-be3b-185f85f30890+11:18695:x1875544001113600:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 296us (496us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788658784.442614:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00010000:00010000:3.0:1788658784.447992:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658784.500173:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658784.500301:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001113728 00000100:00100000:1.0:1788658784.500323:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001113728 00000100:00100000:1.0:1788658784.500408:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:1.0:1788658784.500421:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+11:18701:x1875544001113728:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:1.0:1788658784.500458:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658784.500488:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccdca expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500588:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671800/0x48e67cc629c70900 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500606:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671800/0x48e67cc629c70900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500621:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671800/0x48e67cc629c70900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500654:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c70907 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500662:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c70907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500670:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c70907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500814:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c7090e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500824:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c7090e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500831:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c7090e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658784.500874:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788658784.500879:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788658784.500929:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c7090e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500954:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671800/0x48e67cc629c70900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500962:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671800/0x48e67cc629c70900 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500970:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671800/0x48e67cc629c70900 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.500987:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658784.500992:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671800/0x48e67cc629c70900 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501001:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671800/0x48e67cc629c70900 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501017:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83409a00) 00010000:00010000:1.0:1788658784.501021:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658784.501027:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671800/0x48e67cc629c70900 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501035:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671800/0x48e67cc629c70900 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501055:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c70907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501061:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c70907 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501066:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c70907 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501071:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658784.501075:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c70907 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501081:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c70907 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501099:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a1d83409e00) 00010000:00010000:1.0:1788658784.501102:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658784.501105:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c70907 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501111:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c70907 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501140:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c708f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdca expref: 13 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501155:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c7090e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdca expref: 12 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.501163:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a1e83ad6100) 00010000:00010000:1.0:1788658784.501165:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788658784.501168:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670600, rc 0) 00000100:00100000:1.0:1788658784.501278:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+12:18701:x1875544001113728:12345-192.168.202.53@tcp:101:bash.0 Request processed in 859us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.501286:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 35 00000040:00080000:3.0:1788658784.512063:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788658784.514896:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.515081:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001113856 00000100:00100000:0.0:1788658784.515094:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001113856 00000100:00100000:0.0:1788658784.515167:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1788658784.515179:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:18701:x1875544001113856:12345-192.168.202.53@tcp:900:bash.0 00000100:00100000:0.0:1788658784.515458:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:18701:x1875544001113856:12345-192.168.202.53@tcp:900:bash.0 Request processed in 280us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.515467:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:3.0:1788658784.517406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.517648:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001114112 00000100:00100000:0.0:1788658784.517660:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001114112 00000100:00100000:0.0:1788658784.517815:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:0.0:1788658784.517826:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+12:18701:x1875544001114112:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1788658784.517849:0:25613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658784.517876:0:25613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c70915 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccdd1 expref: -99 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.518190:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.518223:0:25613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdc3 expref: 10 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.518291:0:25613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.518439:0:25613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdc3 expref: 10 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.518526:0:25613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdc3 expref: 10 pid: 22722 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658784.519021:0:25613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f08700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25613:1875544025347456:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658784.519170:0:25613:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebce433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658784.525071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.526794:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001114240 00000100:00100000:2.0:1788658784.526815:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001114240 00010000:00010000:2.0:1788658784.526907:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdc3 expref: 11 pid: 22722 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658784.526975:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1788658784.526989:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7102ec86-86cd-4996-be3b-185f85f30890+11:2396:x1875544001114240:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658784.527009:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658784.527018:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdc3 expref: 11 pid: 22722 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.527035:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdc3 expref: 11 pid: 22722 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.527064:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a1e83ad6100) 00010000:00010000:2.0:1788658784.527071:0:22707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.527084:0:22707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.527094:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.527118:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658784.527195:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7102ec86-86cd-4996-be3b-185f85f30890+11:2396:x1875544001114240:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 209us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658784.527203:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00010000:00010000:0.0:1788658784.529263:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c708f2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdc3 expref: 10 pid: 22722 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658784.529292:0:25613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f08700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25613:1875544025347456:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658784.529433:0:25613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.529446:0:25613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.529514:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.529678:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.529857:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.529871:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530408:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c7092a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530419:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c7092a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530428:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c7092a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658784.530440:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788658784.530466:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530474:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530481:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530486:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf602200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658784.530491:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530498:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530525:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a1e83ad6100) 00010000:00010000:0.0:1788658784.530528:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658784.530534:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530540:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602200/0x48e67cc629c7091c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658784.530552:0:25613:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042a394c9 reply state 000000007c347c62 transno 12884901894 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530562:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530568:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8a1eb24bb400) 00010000:00010000:0.0:1788658784.530571:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658784.530574:0:25613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788658784.530611:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c70915 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd1 expref: 15 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530628:0:25613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c7092a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd1 expref: 14 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.530635:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:0.0:1788658784.530637:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788658784.530640:0:25613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418200, rc 0) 00000100:00100000:0.0:1788658784.530761:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+15:18701:x1875544001114112:12345-192.168.202.53@tcp:101:bash.0 Request processed in 12935us (13366us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788658784.530771:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:3.0:1788658784.548562:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.548785:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001114368 00000100:00100000:2.0:1788658784.548799:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001114368 00000100:00100000:2.0:1788658784.548884:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:2.0:1788658784.548914:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+15:18701:x1875544001114368:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658784.548961:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658784.548990:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c70938 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccdd8 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.549086:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.549105:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.549131:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658784.549194:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788658784.549199:0:22724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658784.549229:0:22724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.549242:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.549273:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c70938 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd8 expref: 17 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.549298:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd8 expref: 16 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.549307:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:2.0:1788658784.549310:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658784.549390:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1a00, rc 0) 00000100:00100000:2.0:1788658784.549474:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+16:18701:x1875544001114368:12345-192.168.202.53@tcp:101:bash.0 Request processed in 564us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658784.549483:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:3.0:1788658784.553846:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.554012:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001114624 00000100:00100000:2.0:1788658784.554024:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001114624 00000100:00100000:2.0:1788658784.554096:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1788658784.554110:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2017850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+16:18701:x1875544001114624:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:2.0:1788658784.554522:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2017850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+17:18701:x1875544001114624:12345-192.168.202.53@tcp:35:bash.0 Request processed in 414us (690us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788658784.554532:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:1.0:1788658784.572679:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.572915:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001114752 00000100:00100000:0.0:1788658784.572927:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001114752 00000100:00100000:0.0:1788658784.573064:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 158 00000100:00100000:0.0:1788658784.573076:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e87d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+11:18062:x1875544001114752:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658784.573094:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658784.573112:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83418400/0x48e67cc629c70946 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccddf expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.573143:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83418400/0x48e67cc629c70946 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccddf expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.573155:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83418400/0x48e67cc629c70946 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccddf expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.573164:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418400, rc 0) 00000100:00100000:0.0:1788658784.573226:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e87d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+12:18062:x1875544001114752:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 152us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.573234:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 158 00000100:00100000:3.0:1788658784.577798:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658784.579815:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001114880 00000100:00100000:1.0:1788658784.579829:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001114880 00000100:00100000:1.0:1788658784.579900:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 159 00000100:00100000:1.0:1788658784.579912:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+12:18062:x1875544001114880:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658784.580085:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+12:18062:x1875544001114880:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 175us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.580111:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 159 00000100:00100000:1.0:1788658784.583110:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.587818:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001115008 00000100:00100000:0.0:1788658784.587833:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001115008 00000100:00100000:0.0:1788658784.587911:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 160 00000100:00100000:0.0:1788658784.587922:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+12:18062:x1875544001115008:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658784.588094:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+12:18062:x1875544001115008:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 173us (4994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.588103:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 160 00000100:00100000:2.0:1788658784.600825:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658784.601268:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001115136 00000100:00100000:3.0:1788658784.601279:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001115136 00000100:00100000:3.0:1788658784.601337:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 161 00000100:00100000:3.0:1788658784.601348:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+12:18062:x1875544001115136:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658784.601366:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658784.601385:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a0e00/0x48e67cc629c7094d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccde6 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.601413:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a0e00/0x48e67cc629c7094d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccde6 expref: 13 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.601426:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a0e00/0x48e67cc629c7094d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccde6 expref: 13 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658784.601435:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0e00, rc 0) 00000100:00100000:3.0:1788658784.601495:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+13:18062:x1875544001115136:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 149us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658784.601502:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 161 00000100:00100000:2.0:1788658784.612885:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658784.612981:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001115264 00000100:00100000:3.0:1788658784.612991:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001115264 00000100:00100000:3.0:1788658784.613070:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 162 00000100:00100000:3.0:1788658784.613080:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+13:18062:x1875544001115264:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658784.613227:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a253e119-3367-4bac-b369-351e630e7e49+13:18062:x1875544001115264:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 148us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658784.613234:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 162 00000100:00100000:1.0:1788658784.617141:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.617243:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001115392 00000100:00100000:0.0:1788658784.617266:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001115392 00000100:00100000:0.0:1788658784.617347:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 163 00000100:00100000:0.0:1788658784.617358:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+13:18062:x1875544001115392:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658784.617530:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a253e119-3367-4bac-b369-351e630e7e49+13:18062:x1875544001115392:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 173us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.617539:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 163 00000100:00100000:2.0:1788658784.725057:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.726097:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001115648 00000100:00100000:0.0:1788658784.726112:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001115648 00000100:00100000:0.0:1788658784.726180:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:0.0:1788658784.726191:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+17:18713:x1875544001115648:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658784.726216:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658784.726252:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c70954 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccded expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658784.726379:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788658784.726512:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c70954 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccded expref: 19 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.726535:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83409a00) 00010000:00010000:0.0:1788658784.726539:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658784.726545:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c70954 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccded expref: 19 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.726562:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418e00, rc 0) 00000100:00100000:0.0:1788658784.726629:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+18:18713:x1875544001115648:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 439us (1580us total) trans 12884901896 rc 301/301 00000100:00100000:0.0:1788658784.726637:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:2.0:1788658784.732157:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.732242:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001115904 00000100:00100000:0.0:1788658784.732280:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001115904 00000100:00100000:0.0:1788658784.732349:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:0.0:1788658784.732360:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+18:18713:x1875544001115904:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1788658784.732617:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+19:18713:x1875544001115904:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 257us (468us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788658784.732626:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000040:00080000:0.0:1788658784.769911:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788658784.807513:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658784.807759:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001116160 00000100:00100000:2.0:1788658784.807769:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001116160 00000100:00100000:2.0:1788658784.807835:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:2.0:1788658784.807846:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+19:18716:x1875544001116160:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658784.807869:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658784.807890:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c70962 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccdf4 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.808016:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2800/0x48e67cc629c70969 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.808032:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2800/0x48e67cc629c70969 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.808067:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2800/0x48e67cc629c70969 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658784.808079:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788658784.808189:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c70962 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdf4 expref: 22 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.808210:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2800/0x48e67cc629c70969 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdf4 expref: 21 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658784.808217:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:2.0:1788658784.808220:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658784.808223:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2800, rc 0) 00000100:00100000:2.0:1788658784.808281:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+21:18716:x1875544001116160:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 437us (778us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1788658784.808879:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:3.0:1788658784.812628:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.812755:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001116288 00000100:00100000:0.0:1788658784.812765:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001116288 00000100:00100000:0.0:1788658784.812825:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:0.0:1788658784.812835:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+21:18716:x1875544001116288:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:0.0:1788658784.812913:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c70977 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.812930:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c70977 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.812943:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c70977 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.812983:0:22722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c70977 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.812990:0:22722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c70977 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.812997:0:22722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c70977 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.813014:0:22722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658784.813034:0:22722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c70977 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.813042:0:22722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c70977 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.813055:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:0.0:1788658784.813059:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658784.813064:0:22722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c70977 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658784.813071:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c70977 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658784.813152:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+21:18716:x1875544001116288:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 317us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658784.813160:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:0.0:1788658784.815649:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658784.815748:0:25753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001116416 00000100:00100000:1.0:1788658784.815757:0:25753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001116416 00000100:00100000:1.0:1788658784.815819:0:25753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:1.0:1788658784.815829:0:25753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+21:2398:x1875544001116416:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658784.815845:0:25753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658784.815871:0:25753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2800/0x48e67cc629c70969 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdf4 expref: 21 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658784.815892:0:25753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:1.0:1788658784.815897:0:25753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658784.815967:0:25753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+20:2398:x1875544001116416:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 139us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658784.815975:0:25753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:1.0:1788658784.819925:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658784.820340:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001116672 00000100:00100000:0.0:1788658784.820351:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001116672 00000100:00100000:0.0:1788658784.820418:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:0.0:1788658784.820428:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+20:18716:x1875544001116672:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1788658784.820667:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+21:18716:x1875544001116672:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 240us (751us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788658784.820676:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:3.0:1788658785.273528:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658785.273739:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001116928 00000100:00100000:2.0:1788658785.273749:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001116928 00000100:00100000:2.0:1788658785.273810:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:2.0:1788658785.273820:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+21:18747:x1875544001116928:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:2.0:1788658785.273843:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658785.273862:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7097e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccdfb expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.273973:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c70985 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.274009:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c70985 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.274022:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c70985 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658785.274034:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788658785.274165:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7097e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdfb expref: 24 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.274185:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c70985 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdfb expref: 23 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.274194:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:2.0:1788658785.274196:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658785.274200:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2600, rc 0) 00000100:00100000:2.0:1788658785.274533:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+23:18747:x1875544001116928:12345-192.168.202.53@tcp:101:cat.0 Request processed in 713us (1014us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788658785.274542:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:1.0:1788658785.281498:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658785.281868:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001117056 00000100:00100000:2.0:1788658785.281879:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001117056 00000100:00100000:2.0:1788658785.282026:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:2.0:1788658785.282037:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+23:2398:x1875544001117056:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658785.282054:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658785.282081:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c70985 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdfb expref: 23 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.282135:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:2.0:1788658785.282140:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658785.282215:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+22:2398:x1875544001117056:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 179us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658785.282399:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:1.0:1788658785.284122:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658785.284325:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001117312 00000100:00100000:0.0:1788658785.284335:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001117312 00000100:00100000:0.0:1788658785.284448:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1788658785.284460:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+22:18747:x1875544001117312:12345-192.168.202.53@tcp:35:cat.0 00000100:00100000:0.0:1788658785.284886:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+23:18747:x1875544001117312:12345-192.168.202.53@tcp:35:cat.0 Request processed in 428us (773us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788658785.284892:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1788658785.370173:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658785.370335:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001117568 00000100:00100000:2.0:1788658785.370346:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001117568 00000100:00100000:2.0:1788658785.370620:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:2.0:1788658785.370632:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+23:18753:x1875544001117568:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:2.0:1788658785.370656:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658785.370677:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c70993 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcce02 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.370813:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7099a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.370829:0:22722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c7092a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd1 expref: 24 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.370838:0:22722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd8 expref: 24 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.370846:0:22722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7099a lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.370884:0:22722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd8 expref: 24 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.370915:0:22722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd8 expref: 24 pid: 22724 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658785.370929:0:22722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22722:1875544025347584:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658785.371029:0:22722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c7092a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd1 expref: 24 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.371038:0:22722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c7092a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd1 expref: 24 pid: 25613 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658785.371046:0:22722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d823aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22722:1875544025347712:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658785.371069:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb757a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658785.377447:0:22722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22722:1875544025347584:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658785.377466:0:22722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d823aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22722:1875544025347712:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658785.377494:0:22722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7099a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658785.377773:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658785.377823:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658785.377911:0:25753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001117824 00000100:00100000:2.0:1788658785.377914:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001117696 00000100:00100000:2.0:1788658785.377917:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001117696 00000100:00100000:1.0:1788658785.377917:0:25753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001117824 00010000:00010000:1.0:1788658785.378134:0:25753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd8 expref: 26 pid: 22724 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658785.378182:0:25753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:1.0:1788658785.378209:0:25753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+26:2396:x1875544001117824:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658785.378224:0:25753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658785.378231:0:25753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd8 expref: 26 pid: 22724 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658785.378245:0:25753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd8 expref: 26 pid: 22724 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658785.378266:0:25753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c7093f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd8 expref: 26 pid: 22724 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658785.378284:0:25753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:1.0:1788658785.378288:0:25753:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7099a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658785.378296:0:25753:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7099a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658785.378302:0:25753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658785.378361:0:25753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+25:2396:x1875544001117824:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 154us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658785.378369:0:25753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00010000:00010000:2.0:1788658785.382151:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c7092a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd1 expref: 25 pid: 25613 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658785.382211:0:25753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:1.0:1788658785.382320:0:25753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83ca0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+24:2396:x1875544001117696:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658785.382335:0:25753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658785.382343:0:25753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c7092a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd1 expref: 24 pid: 25613 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658785.382400:0:25753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c7092a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd1 expref: 24 pid: 25613 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658785.382425:0:25753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c7092a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccdd1 expref: 24 pid: 25613 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658785.382445:0:25753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:1.0:1788658785.382451:0:25753:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7099a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658785.382461:0:25753:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7099a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658785.382469:0:25753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7099a lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658785.382505:0:25753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658785.382568:0:25753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83ca0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+23:2396:x1875544001117696:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 263us (4744us total) trans 0 rc 0/0 00010000:00010000:0.0:1788658785.382740:0:22722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7099a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.382749:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7099a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658785.382770:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788658785.382925:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c70993 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce02 expref: 25 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.382944:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2400/0x48e67cc629c7099a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce02 expref: 24 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.382952:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:0.0:1788658785.382954:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788658785.382957:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2400, rc 0) 00000100:00100000:0.0:1788658785.382985:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+24:18753:x1875544001117568:12345-192.168.202.53@tcp:101:dd.0 Request processed in 12357us (12821us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788658785.382992:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:1.0:1788658785.387935:0:25753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1788658785.388880:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.388993:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001117952 00000100:00100000:3.0:1788658785.389014:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001117952 00000100:00100000:3.0:1788658785.389073:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:3.0:1788658785.389084:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+23:18753:x1875544001117952:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:3.0:1788658785.389120:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658785.389142:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c709a8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcce09 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.389179:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c709af lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.389193:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c709af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.389206:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c709af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.389338:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c709a8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce09 expref: 25 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.389357:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c709af lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce09 expref: 24 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.389373:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:3.0:1788658785.389850:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658785.389857:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1c00, rc 0) 00000100:00100000:3.0:1788658785.389960:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+24:18753:x1875544001117952:12345-192.168.202.53@tcp:101:dd.0 Request processed in 876us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.389968:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:2.0:1788658785.395094:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.395201:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001118208 00000100:00100000:3.0:1788658785.395213:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001118208 00000100:00100000:3.0:1788658785.395320:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:3.0:1788658785.395332:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d823aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+24:18753:x1875544001118208:12345-192.168.202.53@tcp:36:dd.0 00010000:00010000:3.0:1788658785.395590:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.395608:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.395621:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658785.395663:0:25613:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901903 00000004:00010000:3.0:1788658785.395687:0:25613:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bc9e5bd reply state 000000000e115a91 transno 12884901904 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.395699:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.395741:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:3.0:1788658785.395744:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658785.395766:0:25613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658785.395870:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d823aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+27:18753:x1875544001118208:12345-192.168.202.53@tcp:36:dd.0 Request processed in 539us (1176us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788658785.395878:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00000020:00080000:3.0:1788658785.395883:0:25613:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788658785.399226:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658785.399316:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001118336 00000100:00100000:2.0:1788658785.399326:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001118336 00000100:00100000:2.0:1788658785.399484:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:2.0:1788658785.399496:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+27:18753:x1875544001118336:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:2.0:1788658785.399517:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658785.399536:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3800/0x48e67cc629c709bd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcce10 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.399588:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3800/0x48e67cc629c709bd lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce10 expref: 28 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.399603:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3800/0x48e67cc629c709bd lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce10 expref: 28 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.399619:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:2.0:1788658785.399623:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658785.399626:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b3800, rc 0) 00000100:00100000:2.0:1788658785.399681:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+28:18753:x1875544001118336:12345-192.168.202.53@tcp:101:dd.0 Request processed in 188us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658785.399689:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:1.0:1788658785.415246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.415473:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001118592 00000100:00100000:3.0:1788658785.415484:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001118592 00000100:00100000:3.0:1788658785.415562:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1788658785.415573:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+28:18753:x1875544001118592:12345-192.168.202.53@tcp:103:dd.0 00010000:00010000:3.0:1788658785.415589:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658785.415617:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3800/0x48e67cc629c709bd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce10 expref: 28 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.415640:0:22708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:3.0:1788658785.415645:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658785.416246:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+27:18753:x1875544001118592:12345-192.168.202.53@tcp:103:dd.0 Request processed in 670us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.416256:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:2.0:1788658785.418204:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658785.418570:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001118720 00000100:00100000:0.0:1788658785.418595:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001118720 00000100:00100000:0.0:1788658785.418657:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:0.0:1788658785.418667:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+27:18753:x1875544001118720:12345-192.168.202.53@tcp:58:dd.0 00010000:00010000:0.0:1788658785.418806:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.418825:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.418838:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658785.420739:0:22722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658785.420775:0:22722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788658785.420924:0:22722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788658785.421138:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+27:18753:x1875544001118720:12345-192.168.202.53@tcp:58:dd.0 Request processed in 2465us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658785.421152:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:0.0:1788658785.424128:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.424204:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001118848 00000100:00100000:3.0:1788658785.424214:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001118848 00000100:00100000:3.0:1788658785.424276:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:3.0:1788658785.424287:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+27:18753:x1875544001118848:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:3.0:1788658785.424307:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658785.424327:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c709cb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcce17 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.424390:0:22724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.424859:0:22724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c709cb lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce17 expref: 28 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.424877:0:22724:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.424890:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c709cb lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce17 expref: 28 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.424905:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:3.0:1788658785.424909:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658785.424913:0:22724:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c709cb lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce17 expref: 28 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.424921:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1e00, rc 0) 00000100:00100000:3.0:1788658785.424986:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+28:18753:x1875544001118848:12345-192.168.202.53@tcp:101:dd.0 Request processed in 701us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.424994:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00010000:00010000:3.0:1788658785.470916:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658785.791471:0:22758:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788658785.791482:0:22758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658785.791533:0:22758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788658785.791544:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788658785.791727:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f09880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22758:1875544025347840:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788658785.791848:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebce43780 going to sleep for 11 seconds 00000100:00100000:0.0:1788658785.805269:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.805592:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001118976 00000100:00100000:3.0:1788658785.805601:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001118976 00000100:00100000:3.0:1788658785.805663:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:3.0:1788658785.805675:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+29:18755:x1875544001118976:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788658785.805750:0:25613:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788658785.805874:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+29:18755:x1875544001118976:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 201us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.805900:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:1.0:1788658785.816475:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.816732:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001119104 00000100:00100000:3.0:1788658785.816743:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001119104 00000100:00100000:3.0:1788658785.816805:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:3.0:1788658785.816816:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+29:18755:x1875544001119104:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788658785.816884:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c709d2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.816900:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c709d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.816914:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c709d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.816929:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.816937:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.816943:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.816966:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.816974:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.816981:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658785.817051:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788658785.817055:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658785.817072:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817084:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c709d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817091:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c709d2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817098:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c709d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817105:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658785.817109:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c709d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817117:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c709d2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817128:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83409200) 00010000:00010000:3.0:1788658785.817131:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658785.817135:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c709d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817141:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c709d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817154:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817171:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709d9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817185:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817191:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658785.817194:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817200:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709d9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817208:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8a1e83ad6c00) 00010000:00010000:3.0:1788658785.817211:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658785.817214:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709d9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817220:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709d9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817235:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817241:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817247:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817252:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658785.817259:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817265:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817271:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:3.0:1788658785.817273:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658785.817276:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.817281:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658785.818903:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+29:18755:x1875544001119104:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 Request processed in 2080us (2442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.818917:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:2.0:1788658785.821998:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f09880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22758:1875544025347840:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788658785.832581:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.832670:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001119360 00000100:00100000:3.0:1788658785.832680:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001119360 00000100:00100000:3.0:1788658785.832759:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:3.0:1788658785.832770:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+28:18755:x1875544001119360:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658785.832789:0:25613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658785.832809:0:25613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcce1e expref: -99 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.832915:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709ee lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.832931:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.832964:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658785.832977:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788658785.833059:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.833067:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709ee lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.833075:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709ee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.833080:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658785.833084:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709ee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.833091:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709ee lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.833104:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:3.0:1788658785.833107:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788658785.833111:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709ee lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.833117:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c709ee lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.833161:0:25613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce1e expref: 30 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.833195:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83409200) 00010000:00010000:3.0:1788658785.833197:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658785.833202:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c709e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce1e expref: 30 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.833212:0:25613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1800, rc 0) 00000100:00100000:3.0:1788658785.833277:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+29:18755:x1875544001119360:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 509us (707us total) trans 12884901905 rc 301/301 00000100:00100000:3.0:1788658785.833285:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:1.0:1788658785.839863:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658785.839986:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001119488 00000100:00100000:0.0:1788658785.839996:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001119488 00000100:00100000:0.0:1788658785.840058:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:0.0:1788658785.840067:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+29:18755:x1875544001119488:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788658785.840126:0:22724:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788658785.840261:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+29:18755:x1875544001119488:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 195us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658785.840270:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:1.0:1788658785.847124:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658785.848054:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001119744 00000100:00100000:0.0:1788658785.848069:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001119744 00000100:00100000:0.0:1788658785.848147:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:0.0:1788658785.848158:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+29:18755:x1875544001119744:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658785.848181:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658785.848219:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c709fc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcce25 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658785.848618:0:22722:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =59 00000004:00080000:0.0:1788658785.848626:0:22722:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+59 in llog 00000004:00080000:0.0:1788658785.848644:0:22722:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:0.0:1788658785.848859:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c70a03 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.848874:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c70a03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.848886:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c70a03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.848954:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c709fc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce25 expref: 32 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.848971:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c70a03 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce25 expref: 31 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.848995:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bbb00) 00010000:00010000:0.0:1788658785.848998:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658785.849003:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419600, rc 0) 00000100:00100000:0.0:1788658785.849061:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+31:18755:x1875544001119744:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 905us (1948us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788658785.849068:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:1.0:1788658785.858273:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.858354:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001120000 00000100:00100000:3.0:1788658785.858366:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001120000 00000100:00100000:3.0:1788658785.858427:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:3.0:1788658785.858438:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+31:18755:x1875544001120000:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788658785.858495:0:22723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658785.858522:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c70a03 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce25 expref: 31 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858541:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bbb00) 00010000:00010000:3.0:1788658785.858552:0:22723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658785.858574:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a11 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858588:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a11 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858598:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a11 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858630:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a18 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8f88c957 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858638:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8f88c957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858645:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8f88c957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858691:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a11 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858699:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a11 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858738:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a11 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858745:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658785.858750:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a11 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858758:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a11 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858767:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a1e83ad6100) 00010000:00010000:3.0:1788658785.858769:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658785.858772:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a11 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858779:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a11 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858795:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8f88c957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858801:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a18 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8f88c957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858807:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a18 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8f88c957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858813:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658785.858815:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a18 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8f88c957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858821:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a18 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8f88c957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858828:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x8f88c957 (ffff8a1e83ad6c00) 00010000:00010000:3.0:1788658785.858830:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658785.858833:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a18 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8f88c957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.858838:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a18 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8f88c957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658785.858910:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+30:18755:x1875544001120000:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 474us (647us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788658785.858918:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:1.0:1788658785.866622:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658785.866749:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001120128 00000100:00100000:0.0:1788658785.866759:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001120128 00000100:00100000:0.0:1788658785.866824:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:0.0:1788658785.866835:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+30:18755:x1875544001120128:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658785.866859:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658785.866883:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a1f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcce2c expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.866922:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c70a26 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.866950:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c70a26 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.866964:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c70a26 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.867089:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a1f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce2c expref: 32 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.867109:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c70a26 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce2c expref: 31 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.867125:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bb200) 00010000:00010000:0.0:1788658785.867128:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658785.867132:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418c00, rc 0) 00000100:00100000:0.0:1788658785.867184:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+31:18755:x1875544001120128:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 351us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658785.867209:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:1.0:1788658785.872523:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658785.872631:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001120384 00000100:00100000:0.0:1788658785.872641:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001120384 00000100:00100000:0.0:1788658785.872736:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:0.0:1788658785.872747:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+31:18755:x1875544001120384:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788658785.872847:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.872865:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.872878:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658785.873062:0:22724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1788658785.873071:0:22724:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 703089367964ns, next at 704089365591ns, rc = 0 00000004:00010000:0.0:1788658785.873117:0:22724:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b2e1975 reply state 000000001a2ae712 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.873130:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.873138:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bb200) 00010000:00010000:0.0:1788658785.873147:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788658785.873151:0:22724:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658785.873258:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+33:18755:x1875544001120384:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 512us (744us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1788658785.873266:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:1.0:1788658785.882754:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658785.883671:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001120512 00000100:00100000:0.0:1788658785.883684:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001120512 00000100:00100000:0.0:1788658785.883832:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1788658785.883844:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+33:18755:x1875544001120512:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658785.883868:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658785.883889:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a34 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcce33 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.883961:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a34 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce33 expref: 34 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.883977:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a34 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce33 expref: 34 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.883996:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bb200) 00010000:00010000:0.0:1788658785.883999:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658785.884003:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419e00, rc 0) 00000100:00100000:0.0:1788658785.884054:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+34:18755:x1875544001120512:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 213us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658785.884061:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:1.0:1788658785.895306:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.895729:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001120640 00000100:00100000:3.0:1788658785.895740:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001120640 00000100:00100000:3.0:1788658785.895814:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:3.0:1788658785.895839:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2396:x1875544001120640:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788658785.896401:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:2396:x1875544001120640:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 561us (1101us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1788658785.896410:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00080000:0.0:1788658785.896483:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658785.907965:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658785.908211:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001120896 00000100:00100000:2.0:1788658785.908222:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001120896 00000100:00100000:2.0:1788658785.908336:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1788658785.908348:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+34:18755:x1875544001120896:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788658785.908668:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+35:18755:x1875544001120896:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 322us (713us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788658785.908696:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1788658785.913272:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658785.913373:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001121152 00000100:00100000:0.0:1788658785.913384:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001121152 00000100:00100000:0.0:1788658785.913529:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:0.0:1788658785.913540:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+35:18755:x1875544001121152:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788658785.913660:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+35:18755:x1875544001121152:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 121us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658785.913668:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:1.0:1788658785.924659:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.924737:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001121280 00000100:00100000:3.0:1788658785.924748:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001121280 00000100:00100000:3.0:1788658785.924814:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:3.0:1788658785.924825:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+35:18755:x1875544001121280:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658785.924846:0:25613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658785.924867:0:25613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a3b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcce3a expref: -99 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.924940:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a42 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.924954:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a42 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.924968:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a42 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658785.925017:0:25613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658785.925037:0:25613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a42 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.925063:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a3b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce3a expref: 37 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.925081:0:25613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a42 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce3a expref: 36 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.925185:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bb200) 00010000:00010000:3.0:1788658785.925189:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788658785.925193:0:25613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1800, rc 0) 00000100:00100000:3.0:1788658785.925272:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+36:18755:x1875544001121280:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 448us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.925281:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:1.0:1788658785.928799:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658785.929682:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001121408 00000100:00100000:2.0:1788658785.929694:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001121408 00000100:00100000:2.0:1788658785.929817:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1788658785.929828:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+6:2396:x1875544001121408:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658785.929845:0:24896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658785.929867:0:24896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c70a49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcce41 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658785.929894:0:24896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc461, blocks: 0x0 00010000:00010000:2.0:1788658785.929913:0:24896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=703s v=(0 0) 00010000:00010000:2.0:1788658785.929918:0:24896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658785.929928:0:24896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c70a49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce41 expref: 7 pid: 24896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.929947:0:24896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c70a49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce41 expref: 7 pid: 24896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658785.929961:0:24896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b3000, rc 0) 00000100:00100000:2.0:1788658785.930025:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:2396:x1875544001121408:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 199us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658785.930032:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1788658785.938750:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658785.939730:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001121664 00000100:00100000:0.0:1788658785.939743:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001121664 00000100:00100000:0.0:1788658785.939832:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:0.0:1788658785.939845:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+36:18755:x1875544001121664:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788658785.940674:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+36:18755:x1875544001121664:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 827us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658785.940684:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:1.0:1788658785.944332:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.944455:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001121792 00000100:00100000:3.0:1788658785.944466:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001121792 00000100:00100000:3.0:1788658785.944537:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:3.0:1788658785.944548:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+36:18755:x1875544001121792:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788658785.953760:0:22702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901908 is committed 00000004:00080000:1.0:1788658785.953785:0:22702:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788658785.953854:0:22702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901893 is committed 00010000:00010000:3.0:1788658785.954014:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.954028:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.954037:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.954043:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658785.954048:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.954056:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.954074:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a1e83ad6100) 00010000:00010000:3.0:1788658785.954091:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788658785.954097:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.954103:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c708e4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658785.954278:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+19:18755:x1875544001121792:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 Request processed in 9727us (9950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.954288:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:1.0:1788658785.954671:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658785.954689:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025347968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788658785.954783:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658785.954991:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025347968 00000100:00100000:2.0:1788658785.955007:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025347968 00000100:00100000:2.0:1788658785.955054:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658785.955063:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025347968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788658785.955188:0:24228:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788658785.955192:0:24228:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788658785.955194:0:24228:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788658785.955196:0:24228:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788658785 -> 1788658785 00002000:00010000:2.0:1788658785.955198:0:24228:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788658785.955244:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875544025347968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (461us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788658785.955251:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:1.0:1788658785.955440:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1d83d53480/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788658785.955446:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025347968:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788658785.956639:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956654:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956662:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956668:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658785.956673:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956681:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956697:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a1d83409e00) 00010000:00010000:0.0:1788658785.956728:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658785.956734:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956741:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1000/0x48e67cc629c70890 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956766:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956773:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956779:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956785:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658785.956788:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956794:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956802:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a1e83ad6100) 00010000:00010000:0.0:1788658785.956805:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658785.956808:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956814:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c70897 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956836:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956853:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956859:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956863:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658785.956866:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956872:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956881:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8a1eb24bb400) 00010000:00010000:0.0:1788658785.956883:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658785.956886:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956891:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c70923 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956904:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956910:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956916:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956920:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658785.956927:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956934:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.956941:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:0.0:1788658785.956943:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658785.956945:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.957126:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c709b6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.957142:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.957148:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.957153:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.957158:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658785.957161:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.957167:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.957175:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bb200) 00010000:00010000:0.0:1788658785.957177:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788658785.957186:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.957192:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a2d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658785.960320:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658785.960765:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001121920 00000100:00100000:2.0:1788658785.960775:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001121920 00000100:00100000:2.0:1788658785.960826:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:2.0:1788658785.960836:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:2396:x1875544001121920:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788658785.960945:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:2396:x1875544001121920:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 Request processed in 110us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658785.960954:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:1.0:1788658785.964550:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.964673:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001122176 00000100:00100000:3.0:1788658785.964684:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001122176 00000100:00100000:3.0:1788658785.964765:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:3.0:1788658785.964774:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+15:18755:x1875544001122176:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788658785.964823:0:22723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658785.964845:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a42 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce3a expref: 15 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.964864:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bb200) 00010000:00010000:3.0:1788658785.964869:0:22723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658785.964895:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a50 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.964910:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a50 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.964919:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a50 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658785.965038:0:22723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a6f12c0 reply state 00000000ec95b442 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a50 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.965063:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c70a50 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.965069:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bb200) 00010000:00010000:3.0:1788658785.965072:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658785.965074:0:22723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658785.965166:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+16:18755:x1875544001122176:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 392us (625us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788658785.965173:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:1.0:1788658785.969997:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658785.970121:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001122304 00000100:00100000:2.0:1788658785.970131:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001122304 00000100:00100000:2.0:1788658785.970244:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:2.0:1788658785.970255:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:2396:x1875544001122304:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788658785.970439:0:24896:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788658785.970443:0:24896:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788658784 00002000:00010000:2.0:1788658785.970446:0:24896:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788658784 00002000:00010000:2.0:1788658785.970449:0:24896:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788658785 -> 1788658784 00002000:00010000:2.0:1788658785.970467:0:24896:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788658785.970555:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+8:2396:x1875544001122304:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 301us (567us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788658785.970564:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:1.0:1788658785.976354:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.977342:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001122432 00000100:00100000:3.0:1788658785.977356:0:25305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001122432 00000100:00100000:3.0:1788658785.977438:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:3.0:1788658785.977450:0:25305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+8:2398:x1875544001122432:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788658785.977861:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c70a57 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.977879:0:25305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658785.977884:0:25305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658785.977890:0:25305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c70a57 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.977905:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c70a57 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.977933:0:25305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c70a57 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.977963:0:25305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c70a57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.977970:0:25305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c70a57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.977977:0:25305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658785.977981:0:25305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c70a57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.977990:0:25305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c70a57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.978004:0:25305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c70a57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.978012:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c70a57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658785.978097:0:25305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+8:2398:x1875544001122432:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 Request processed in 649us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.978179:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:3.0:1788658785.980269:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.980308:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.980335:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.980385:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.980413:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.980438:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.980460:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.980489:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001123072 00000100:00100000:3.0:1788658785.980510:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001123072 00000100:00100000:3.0:1788658785.980562:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001122688 00000100:00100000:3.0:1788658785.980566:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001122688 00000100:00100000:3.0:1788658785.980581:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001122944 00000100:00100000:3.0:1788658785.980583:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001122944 00000100:00100000:3.0:1788658785.980600:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:3.0:1788658785.980609:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7102ec86-86cd-4996-be3b-185f85f30890+5:2397:x1875544001123072:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658785.980674:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7102ec86-86cd-4996-be3b-185f85f30890+5:2397:x1875544001123072:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 67us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.980682:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:3.0:1788658785.980700:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:3.0:1788658785.980733:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2397:x1875544001122688:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658785.980757:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2397:x1875544001122688:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.980762:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:3.0:1788658785.980772:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:3.0:1788658785.980778:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7102ec86-86cd-4996-be3b-185f85f30890+6:2397:x1875544001122944:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658785.980803:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7102ec86-86cd-4996-be3b-185f85f30890+6:2397:x1875544001122944:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.980809:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1788658785.981198:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001122560 00000100:00100000:0.0:1788658785.981203:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001122560 00000100:00100000:0.0:1788658785.981254:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 164 00000100:00100000:0.0:1788658785.981263:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+13:2397:x1875544001122560:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658785.981300:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a253e119-3367-4bac-b369-351e630e7e49+13:2397:x1875544001122560:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 38us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658785.981306:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 164 00000100:00100000:2.0:1788658785.981402:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001122816 00000100:00100000:2.0:1788658785.981406:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001122816 00000100:00100000:2.0:1788658785.981450:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001123328 00000100:00100000:2.0:1788658785.981454:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001123328 00000100:00100000:2.0:1788658785.981475:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001123200 00000100:00100000:2.0:1788658785.981478:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001123200 00000100:00100000:2.0:1788658785.981509:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1788658785.981516:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2397:x1875544001122816:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658785.981545:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2397:x1875544001122816:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 29us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658785.981551:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1788658785.981564:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:2.0:1788658785.981570:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7102ec86-86cd-4996-be3b-185f85f30890+5:2397:x1875544001123328:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658785.981592:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7102ec86-86cd-4996-be3b-185f85f30890+5:2397:x1875544001123328:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658785.981598:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:2.0:1788658785.981609:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1788658785.981615:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7102ec86-86cd-4996-be3b-185f85f30890+5:2397:x1875544001123200:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658785.981637:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7102ec86-86cd-4996-be3b-185f85f30890+5:2397:x1875544001123200:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 22us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658785.981644:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00080000:0.0:1788658785.981835:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658785.981840:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658785.985479:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.985674:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001123584 00000100:00100000:3.0:1788658785.985700:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001123584 00000100:00100000:3.0:1788658785.985790:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:3.0:1788658785.985801:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+16:18755:x1875544001123584:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788658785.985883:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.985901:0:22724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c709af lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce09 expref: 16 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.985911:0:22724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.985948:0:22724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c709af lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce09 expref: 16 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.985963:0:22724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c709af lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce09 expref: 16 pid: 22724 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658785.985977:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22724:1875544025348096:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658785.986058:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e87dad000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658785.990266:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22724:1875544025348096:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658785.990297:0:22724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658785.992729:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658785.993206:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001123712 00000100:00100000:3.0:1788658785.993227:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001123712 00010000:00010000:3.0:1788658785.993270:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c709af lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce09 expref: 17 pid: 22724 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658785.993371:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:3.0:1788658785.993402:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+17:2399:x1875544001123712:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658785.993417:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658785.993424:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c709af lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce09 expref: 17 pid: 22724 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.993438:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c709af lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce09 expref: 17 pid: 22724 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.993462:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c709af lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce09 expref: 17 pid: 22724 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.993480:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:3.0:1788658785.993486:0:22707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c709cb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce17 expref: 16 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.993510:0:22707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.993518:0:22707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.993525:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658785.993558:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658785.993619:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+16:2399:x1875544001123712:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 240us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658785.993633:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00010000:00010000:0.0:1788658785.993696:0:22724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.993733:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.993943:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.993957:0:22724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a34 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce33 expref: 16 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.993964:0:22724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.993995:0:22724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a34 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce33 expref: 16 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658785.994015:0:22724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a34 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce33 expref: 16 pid: 22722 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658785.994030:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f09180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22724:1875544025348224:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658785.994087:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebce439c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658786.001279:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658786.001438:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001123840 00000100:00100000:2.0:1788658786.001447:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001123840 00010000:00010000:2.0:1788658786.001603:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a34 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce33 expref: 17 pid: 22722 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658786.001644:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:2.0:1788658786.001654:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+17:2397:x1875544001123840:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658786.001668:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658786.001674:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a34 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce33 expref: 17 pid: 22722 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.001689:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a34 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce33 expref: 17 pid: 22722 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.001743:0:22708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bb200) 00010000:00010000:2.0:1788658786.001750:0:22708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.001761:0:22708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.001768:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.002334:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658786.002635:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+17:2397:x1875544001123840:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 980us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658786.002645:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00010000:00010000:0.0:1788658786.003049:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a34 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce33 expref: 16 pid: 22722 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658786.003068:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f09180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22724:1875544025348224:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658786.003089:0:22724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.003098:0:22724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.003118:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658786.003254:0:22724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901910 00000001:00080000:0.0:1788658786.003375:0:22724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901911 00000001:00080000:0.0:1788658786.003653:0:22724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000100:00100000:0.0:1788658786.003775:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f09180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22724:1875544025348352:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788658786.003832:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658786.003861:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebce43000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658786.004124:0:25515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025348352 00000100:00100000:2.0:1788658786.004147:0:25515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025348352 00000100:00080000:3.0:1788658786.006153:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658786.006780:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658786.006950:0:25515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788658786.006965:0:25515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22724:x1875544025348352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788658786.007103:0:25515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22724:x1875544025348352:12345-0@lo:1000:mdt00_002.0 Request processed in 144us (3269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658786.007122:0:25515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788658786.007199:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f09180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22724:1875544025348352:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788658786.007441:0:22724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000100:00100000:0.0:1788658786.007532:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f09180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22724:1875544025348480:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788658786.007573:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658786.012888:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebce43e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658786.012973:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025348480 00000100:00100000:1.0:1788658786.012983:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025348480 00000100:00100000:1.0:1788658786.013039:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788658786.013049:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22724:x1875544025348480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788658786.013333:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22724:x1875544025348480:12345-0@lo:1000:mdt00_002.0 Request processed in 284us (5757us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788658786.013341:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788658786.014802:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f09180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22724:1875544025348480:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788658786.014871:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.014883:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.014892:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.014899:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658786.014905:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.014914:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.014932:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bb200) 00010000:00010000:0.0:1788658786.014936:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658786.014941:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.014949:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c70a65 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.014989:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.014996:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.015021:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.015025:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658786.015029:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.015036:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.015046:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:0.0:1788658786.015049:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658786.015655:0:22724:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c709cb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce17 expref: 19 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.015670:0:22724:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c709cb lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce17 expref: 19 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.015680:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c709cb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce17 expref: 19 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.015781:0:22724:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c709cb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce17 expref: 19 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658786.015797:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22724:1875544025348608:192.168.202.53@tcp:105: 00000100:00100000:0.0:1788658786.015921:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebce43e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658786.021661:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658786.021796:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001123968 00000100:00100000:2.0:1788658786.021807:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001123968 00000100:00100000:2.0:1788658786.021909:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:2.0:1788658786.021919:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+20:18753:x1875544001123968:12345-192.168.202.53@tcp:49:dd.0 00000100:00100000:2.0:1788658786.022062:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+20:18753:x1875544001123968:12345-192.168.202.53@tcp:49:dd.0 Request processed in 144us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658786.022071:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:0.0:1788658786.023356:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22724:1875544025348608:192.168.202.53@tcp:105: 00010000:00010000:0.0:1788658786.023420:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.023432:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c709c4 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.023470:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a6c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.023484:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a6c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.023919:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a6c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.023933:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a6c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.023940:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a6c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.023946:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a6c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.023952:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658786.023956:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a6c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.023962:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a6c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.023975:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:0.0:1788658786.023986:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658786.023991:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a6c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.023997:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c70a6c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.024008:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.024014:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.024020:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.024024:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658786.024027:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.024033:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.024042:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:0.0:1788658786.024044:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658786.024047:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.024053:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c70a5e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658786.024306:0:22758:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788658786.024311:0:22758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658786.024334:0:22758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788658786.024340:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788658786.024446:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+19:18755:x1875544001123584:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 38644us (38973us total) trans 12884901914 rc 0/0 00000100:00100000:0.0:1788658786.024456:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 62 00000020:00080000:0.0:1788658786.024462:0:22724:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788658786.029197:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658786.029399:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001124224 00000100:00100000:3.0:1788658786.029411:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001124224 00000100:00100000:3.0:1788658786.029462:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:3.0:1788658786.029473:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2014450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+19:18755:x1875544001124224:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788658786.030084:0:22725:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788658786.030253:0:22725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00010000:00010000:3.0:1788658786.030291:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c70a73 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.030310:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c70a73 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.030323:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c70a73 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.030333:0:22725:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c70a73 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.030340:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c70a73 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.030347:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c70a73 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.030377:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658786.030737:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658786.030744:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c70a73 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658786.030752:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658786.030756:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c70a73 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658786.030765:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c70a73 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658786.030778:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a1eb24bb200) 00010000:00010000:1.0:1788658786.030780:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788658786.030785:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c70a73 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658786.030792:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1c00/0x48e67cc629c70a73 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658786.030804:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658786.030807:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658786.030808:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658786.031336:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2014450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+21:18755:x1875544001124224:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 1858us (2143us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1788658786.031365:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000020:00080000:3.0:1788658786.031371:0:22725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788658786.038463:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658786.038826:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001124352 00000100:00100000:3.0:1788658786.038837:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001124352 00000100:00100000:3.0:1788658786.038929:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:3.0:1788658786.038939:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+21:18753:x1875544001124352:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:3.0:1788658786.038961:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658786.038981:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a7a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcce48 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.039014:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0000/0x48e67cc629c70a81 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.039028:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0000/0x48e67cc629c70a81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.039039:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0000/0x48e67cc629c70a81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.039177:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c70a7a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce48 expref: 23 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.039195:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0000/0x48e67cc629c70a81 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce48 expref: 22 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.039203:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a1eb24bbf00) 00010000:00010000:3.0:1788658786.039206:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658786.039209:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0000, rc 0) 00000100:00100000:3.0:1788658786.039297:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+22:18753:x1875544001124352:12345-192.168.202.53@tcp:101:dd.0 Request processed in 359us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658786.039303:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:1.0:1788658786.083311:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658786.083439:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001124480 00000100:00100000:0.0:1788658786.083450:0:24231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001124480 00000100:00100000:0.0:1788658786.083538:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:0.0:1788658786.083552:0:24231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+8:2397:x1875544001124480:12345-192.168.202.53@tcp:4:dd.0 00010000:00010000:0.0:1788658786.083591:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.083613:0:24231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c70a49 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce41 expref: 8 pid: 24896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.083623:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658786.083628:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658786.083633:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.083671:0:24231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c70a49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce41 expref: 8 pid: 24896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658786.083686:0:24231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c70a49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce41 expref: 8 pid: 24896 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658786.083766:0:24231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24231:1875544025348736:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658786.083867:0:24231:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebce43f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658786.093097:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658786.093180:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658786.093406:0:25753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001124736 00000100:00100000:3.0:1788658786.093416:0:25753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001124736 00010000:00010000:3.0:1788658786.093459:0:25753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c70a49 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce41 expref: 9 pid: 24896 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658786.093505:0:25753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:3.0:1788658786.093514:0:25753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+9:2397:x1875544001124736:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658786.093529:0:25753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658786.093556:0:25753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c70a49 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce41 expref: 9 pid: 24896 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.093572:0:25753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c70a49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce41 expref: 9 pid: 24896 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.093599:0:25753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658786.093604:0:25753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658786.093611:0:25753:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.093621:0:25753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.093642:0:25753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658786.093694:0:25753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+9:2397:x1875544001124736:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 181us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658786.093743:0:25753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00010000:00010000:2.0:1788658786.093965:0:24231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6f63db/0x48e67cc629c70a49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcce41 expref: 8 pid: 24896 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658786.093982:0:24231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24231:1875544025348736:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658786.094003:0:24231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.094014:0:24231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.094022:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658786.097748:0:24233:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788658786.097766:0:24233:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788658786.099144:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001124608 00000100:00100000:0.0:1788658786.099157:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001124608 00000100:00100000:1.0:1788658786.099796:0:25770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:1.0:1788658786.099811:0:25770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+8:2396:x1875544001124608:12345-192.168.202.53@tcp:4:dd.0 00010000:00010000:1.0:1788658786.099852:0:25770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de114b54/0x48e67cc629c70a8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658786.099879:0:25770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658786.099884:0:25770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658786.099890:0:25770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de114b54/0x48e67cc629c70a8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658786.099905:0:25770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de114b54/0x48e67cc629c70a8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788658786.205804:0:25042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:1.0:1788658786.205820:0:25042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1788658786.208912:0:25770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1788658786.208924:0:25770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1788658784 -> 1788658785 00002000:00010000:2.0:1788658786.208926:0:25770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788658784 -> 1788658785 00002000:00010000:2.0:1788658786.208929:0:25770:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1788658786.208946:0:25770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de114b54/0x48e67cc629c70a8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.208961:0:25770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de114b54/0x48e67cc629c70a8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.208969:0:25770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de114b54/0x48e67cc629c70a8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.208977:0:25770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658786.208982:0:25770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de114b54/0x48e67cc629c70a8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.208991:0:25770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de114b54/0x48e67cc629c70a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.209012:0:25770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de114b54/0x48e67cc629c70a8f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658786.209019:0:25770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de114b54/0x48e67cc629c70a8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658786.209157:0:25770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+7:2396:x1875544001124608:12345-192.168.202.53@tcp:4:dd.0 Request processed in 109335us (116054us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788658786.209173:0:25770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00000001:00080000:1.0:1788658786.255892:0:25042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:3.0:1788658786.256099:0:24231:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:3.0:1788658786.256121:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.256136:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.256145:0:24231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.256152:0:24231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658786.256157:0:24231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.256167:0:24231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.256185:0:24231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658786.256193:0:24231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004074225c/0x48e67cc629c70a88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658786.256386:0:24231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08f2ce8d-224b-4fad-8dd9-e86fe4b2c5bd+5:2397:x1875544001124480:12345-192.168.202.53@tcp:4:dd.0 Request processed in 172831us (173079us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788658786.256402:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00010000:00010000:3.0:1788658786.495987:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658787.265381:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658787.265409:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025348864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658787.265492:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658787.268398:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025348864 00000100:00100000:0.0:1788658787.268415:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025348864 00000100:00100000:0.0:1788658787.268512:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788658787.268526:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025348864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658787.268560:0:24230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788658787.268645:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025348864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (3153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658787.268653:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788658787.268738:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025348864:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788658787.269060:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788658787.520311:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658787.774927:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658787.774952:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025348992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658787.775032:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658787.775084:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025348992 00000100:00100000:3.0:1788658787.775092:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025348992 00000100:00100000:3.0:1788658787.775141:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788658787.775151:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025348992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658787.775208:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788658787.775255:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025348992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658787.775262:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788658787.775307:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025348992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658787.781601:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025349120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658787.781674:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658787.781980:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025349120 00000100:00100000:2.0:1788658787.781989:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025349120 00000100:00100000:2.0:1788658787.782047:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788658787.782057:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025349120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658787.782091:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788658787.782154:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025349120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658787.782162:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788658787.782378:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025349120:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788658788.320439:0:25807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788658788.554965:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658788.613887:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788658789.310990:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025349248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658789.311068:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658789.311439:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025349248 00000100:00100000:1.0:1788658789.311447:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025349248 00000100:00100000:1.0:1788658789.311509:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658789.311519:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025349248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658789.311550:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788658789.319291:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025349760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658789.319374:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658789.332769:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025349632:0@lo:400:kworker.0 00000100:00100000:0.0:1788658789.332863:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658789.332950:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025349760 00000100:00100000:0.0:1788658789.332959:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025349760 00000100:00100000:0.0:1788658789.333221:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658789.333231:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025349760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658789.333259:0:24230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788658789.333926:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025349760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 695us (14550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658789.333934:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658789.334034:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d835e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025350144:0@lo:400:kworker.0 00000100:00100000:0.0:1788658789.334066:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658789.334131:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658789.335285:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d835e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025350272:0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.335594:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025349504:0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.338021:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658789.338105:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025350016:0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.338353:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658789.338402:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788658789.338411:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025349376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658789.338450:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658789.338472:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb4f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025349888:0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.338494:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658789.338534:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025349504 00000100:00100000:2.0:1788658789.338542:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025349504 00000100:00100000:2.0:1788658789.338587:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788658789.338595:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:3648:x1875544025349504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.338678:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb+24:3648:x1875544025349504:12345-0@lo:400:kworker.0 Request processed in 83us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658789.338685:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788658789.339013:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025350016 00000100:00100000:2.0:1788658789.339017:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025350016 00000100:00100000:2.0:1788658789.339049:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658789.339056:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025350016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.339317:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025350016:12345-0@lo:400:kworker.0 Request processed in 260us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658789.339324:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658789.339345:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025349888 00000100:00100000:2.0:1788658789.339349:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025349888 00000100:00100000:2.0:1788658789.339431:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788658789.339498:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025349888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.339531:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025349888:12345-0@lo:400:kworker.0 Request processed in 36us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658789.339536:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788658789.339580:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025349888:0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.339590:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff20339a-cc79-4b28-8cfb-5b5d564cc9fb:3648:1875544025349504:0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.339598:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025350016:0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.341614:0:25516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025349376 00000100:00100000:2.0:1788658789.341627:0:25516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025349376 00000100:00100000:2.0:1788658789.341814:0:25516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658789.341824:0:25516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025349376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658789.341857:0:25516:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788658789.341949:0:25516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025349376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (3498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658789.341956:0:25516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658789.342008:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025349376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658789.342053:0:25515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025349632 00000100:00100000:2.0:1788658789.342057:0:25515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025349632 00000100:00100000:2.0:1788658789.342096:0:25515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025350144 00000100:00100000:2.0:1788658789.342099:0:25515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025350144 00000100:00100000:2.0:1788658789.343042:0:25515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788658789.343056:0:25515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb4f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025349632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.343309:0:25515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb4f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025349632:12345-0@lo:400:kworker.0 Request processed in 256us (10444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658789.343328:0:25515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788658789.343347:0:25515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658789.343355:0:25515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d835e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025350144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.343884:0:25515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d835e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025350144:12345-0@lo:400:kworker.0 Request processed in 529us (9815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658789.343893:0:25515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658789.344016:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025350400:0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.344053:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658789.345894:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025350528:0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.345952:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658789.346022:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025350912:0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.346043:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658789.346070:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025350400 00000100:00100000:2.0:1788658789.346077:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025350400 00000100:00100000:1.0:1788658789.349053:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025349248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37522us (37972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658789.349069:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658789.349122:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025350528 00000100:00100000:1.0:1788658789.349131:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025350528 00000100:00100000:1.0:1788658789.349184:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025350912 00000100:00100000:1.0:1788658789.349204:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025350912 00000100:00100000:1.0:1788658789.349226:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788658789.349235:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025350528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658789.349305:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025350528:12345-0@lo:400:kworker.0 Request processed in 71us (3352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658789.349311:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788658789.349323:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788658789.349329:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025350912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658789.349362:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025350912:12345-0@lo:400:kworker.0 Request processed in 34us (3319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658789.349368:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788658789.349387:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658789.349391:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658789.349394:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788658789.349397:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658789.349414:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788658789.349419:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025350400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658789.349457:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025350400:12345-0@lo:400:kworker.0 Request processed in 38us (5404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658789.349461:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025350528:0@lo:400:kworker.0 00000100:00100000:1.0:1788658789.349463:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788658789.349495:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb2253b80 x1875544025350912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658789.349506:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025350912:0@lo:400:kworker.0 00000100:00100000:1.0:1788658789.349516:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025350400:0@lo:400:kworker.0 00000100:00100000:0.0:1788658789.350914:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658789.350979:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d835e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025350144:0@lo:400:kworker.0 00000100:00100000:0.0:1788658789.350991:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb4f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025349632:0@lo:400:kworker.0 00000100:00100000:0.0:1788658789.351020:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025350656:0@lo:400:kworker.0 00000100:00100000:0.0:1788658789.351054:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658789.351103:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025350656 00000100:00100000:0.0:1788658789.351108:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025350656 00000100:00100000:0.0:1788658789.351170:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788658789.351178:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d835e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025350656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658789.351218:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d835e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025350656:12345-0@lo:400:kworker.0 Request processed in 41us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658789.351224:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788658789.351243:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788658789.351262:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb2251f80 x1875544025350656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658789.351273:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025350656:0@lo:400:kworker.0 00000100:00100000:0.0:1788658789.351287:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658789.351294:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025350784:0@lo:400:kworker.0 00000100:00100000:0.0:1788658789.351341:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658789.351364:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025350784 00000100:00100000:0.0:1788658789.351368:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025350784 00000100:00100000:0.0:1788658789.351408:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788658789.351415:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d835e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025350784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658789.351908:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d835e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025350784:12345-0@lo:400:kworker.0 Request processed in 492us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658789.351915:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788658789.351934:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658789.351955:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025350784:0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.352638:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025350272 00000100:00100000:2.0:1788658789.352655:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025350272 00000100:00100000:2.0:1788658789.352744:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788658789.352754:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e90631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025350272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658789.352826:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e90631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025350272:12345-0@lo:400:kworker.0 Request processed in 74us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658789.352834:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788658789.354066:0:22718:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658789.354128:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d835e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025350272:0@lo:400:kworker.0 00000100:00100000:3.0:1788658789.358455:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1788658789.358469:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1d83d53480, transno 12884901892 00000004:00080000:3.0:1788658789.358495:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1788658789.358533:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025349248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658789.358602:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025349760:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788658789.568088:0:25306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658790.590997:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13825 lines, 13825 kept, 0 dropped, 0 bad.