00010000:00010000:2.0F:1789683687.968958:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0F:1789683688.034602:0:19524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00000020:00000080:0.0:1789683688.034625:0:19524:0:(genops.c:885:class_export_put()) final put ffff9f0e82d57000/8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00000001:00080000:0.0:1789683688.034654:0:19524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1789683688.034666:0:19524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000020:00000080:3.0F:1789683688.034749:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d57000/8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 for lustre-OST0001 00000020:00000080:3.0:1789683688.034829:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fa5320800 for lustre-OST0001 00000001:00080000:3.0:1789683688.035067:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1789683688.035084:0:17180:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0fc1500cc0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1789683688.035088:0:17180:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0fc060ee00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0fc15009c0 00000020:00080000:3.0:1789683688.035092:0:17180:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0fc060e900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0fa7e14000 00000020:00080000:2.0:1789683688.035165:0:17240:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1789683688.035236:0:17240:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789683688.035470:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683688.035483:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683688.035491:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683688.035498:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683688.035503:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683688.035511:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683688.035526:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:0.0:1789683688.035529:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683688.035535:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683688.035541:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683689.001533:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683689.055096:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850295040:0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.055173:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683689.055186:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850295168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683689.055226:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683689.055230:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850295552:0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.055262:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683689.055268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850295680:0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.055286:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850296064:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.055300:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683689.055314:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683689.055323:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850296192:0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.055338:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850296576:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.055350:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683689.055373:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850296704:0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.055381:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683689.055406:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683689.055420:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850295296:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.055445:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850295424:0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.055452:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683689.055475:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850295808:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.055486:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683689.055944:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683689.056000:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850296320:0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.056025:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683689.056040:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850296832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683689.056060:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683689.056089:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850295040 00000100:00100000:2.0:1789683689.056096:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850295040 00000100:00100000:2.0:1789683689.056139:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789683689.056148:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3647:x1876618850295040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.056198:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3647:x1876618850295040:12345-0@lo:400:kworker.0 Request processed in 51us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683689.056205:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789683689.056247:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850295552 00000100:00100000:2.0:1789683689.056251:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850295552 00000100:00100000:2.0:1789683689.056282:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850296064 00000100:00100000:2.0:1789683689.056285:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850296064 00000100:00100000:2.0:1789683689.056298:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850295424 00000100:00100000:2.0:1789683689.056300:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850295424 00000100:00100000:2.0:1789683689.056316:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789683689.056321:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850295552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.056366:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850295552:12345-0@lo:400:kworker.0 Request processed in 44us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683689.056372:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789683689.056384:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789683689.056389:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850296064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.056413:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850296064:12345-0@lo:400:kworker.0 Request processed in 24us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683689.056418:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789683689.056429:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789683689.056435:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850295424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.056460:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850295424:12345-0@lo:400:kworker.0 Request processed in 26us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683689.056466:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789683689.056484:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850295680 00000100:00100000:2.0:1789683689.056487:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850295680 00000100:00100000:2.0:1789683689.056504:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850296192 00000100:00100000:2.0:1789683689.056506:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850296192 00000100:00100000:2.0:1789683689.056516:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850296576 00000100:00100000:2.0:1789683689.056519:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850296576 00000100:00100000:2.0:1789683689.056530:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850296704 00000100:00100000:2.0:1789683689.056532:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850296704 00000100:00100000:2.0:1789683689.056554:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850296320 00000100:00100000:2.0:1789683689.056557:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850296320 00000100:00100000:2.0:1789683689.056570:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789683689.056575:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850295680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.056611:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850295680:12345-0@lo:400:kworker.0 Request processed in 36us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683689.056616:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789683689.056626:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789683689.056631:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850296192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.056656:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850296192:12345-0@lo:400:kworker.0 Request processed in 25us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683689.056661:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789683689.056672:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683689.056677:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850296576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.056702:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850296576:12345-0@lo:400:kworker.0 Request processed in 25us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683689.056707:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683689.056718:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683689.056737:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850296704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.056764:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850296704:12345-0@lo:400:kworker.0 Request processed in 42us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683689.056779:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683689.056819:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789683689.056826:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850296320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683689.056857:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850296320:12345-0@lo:400:kworker.0 Request processed in 32us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683689.056870:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1789683689.057396:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683689.057401:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683689.057403:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683689.057405:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683689.057428:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850295168 00000100:00100000:0.0:1789683689.057434:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850295168 00000100:00100000:0.0:1789683689.057455:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850296832 00000100:00100000:0.0:1789683689.057458:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850296832 00000100:00100000:0.0:1789683689.057471:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789683689.057477:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850295168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683689.057498:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789683689.057541:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850295168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683689.057547:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789683689.057560:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789683689.057566:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850296832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683689.057576:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789683689.057600:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850296832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683689.057605:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789683689.057646:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1789683689.057652:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0fb7961880, transno 8589934596 00000004:00080000:0.0:1789683689.057664:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1789683689.057688:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850295552:0@lo:400:kworker.0 00000100:00100000:0.0:1789683689.057702:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850296064:0@lo:400:kworker.0 00000100:00100000:0.0:1789683689.057712:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850296576:0@lo:400:kworker.0 00000100:00100000:0.0:1789683689.057734:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850295040:0@lo:400:kworker.0 00000100:00100000:0.0:1789683689.058081:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850296832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683689.058093:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850296320:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.059210:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850295424:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.059222:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850295936:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.059460:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683689.059489:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850296448:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.059510:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683689.059562:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850295936 00000100:00100000:3.0:1789683689.059567:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850295936 00000100:00100000:3.0:1789683689.059617:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789683689.059625:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850295936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.059679:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850295936:12345-0@lo:400:kworker.0 Request processed in 54us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683689.059687:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789683689.059705:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683689.059734:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850295168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683689.059746:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850295680:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.059756:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850296192:0@lo:400:kworker.0 00010000:00080000:3.0:1789683689.059778:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7de0380 x1876618850296704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683689.059807:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850296704:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.059837:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850295936:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.059889:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850296448 00000100:00100000:3.0:1789683689.059893:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850296448 00000100:00100000:3.0:1789683689.059925:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789683689.059932:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850296448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.059966:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850296448:12345-0@lo:400:kworker.0 Request processed in 34us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683689.059972:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789683689.059985:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789683689.059999:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7de1500 x1876618850296448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683689.060008:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850296448:0@lo:400:kworker.0 00000100:00100000:1.0F:1789683689.060692:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850295296 00000100:00100000:1.0:1789683689.060710:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850295296 00000100:00100000:1.0:1789683689.060762:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850295808 00000100:00100000:1.0:1789683689.060766:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850295808 00000100:00100000:3.0:1789683689.061176:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789683689.061193:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850295296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.061448:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850295296:12345-0@lo:400:kworker.0 Request processed in 257us (5995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683689.061505:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789683689.061525:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789683689.061532:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850295808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.061566:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850295808:12345-0@lo:400:kworker.0 Request processed in 36us (5622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683689.061571:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789683689.061607:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850295296:0@lo:400:kworker.0 00000100:00100000:3.0:1789683689.061618:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850295808:0@lo:400:kworker.0 00010000:00010000:2.0:1789683690.016416:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683691.048902:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683691.104245:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850296960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683691.104317:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683691.104379:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850297088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683691.104407:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683691.104444:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850296960 00000100:00100000:2.0:1789683691.104453:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850296960 00000100:00100000:2.0:1789683691.104502:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789683691.104511:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850296960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683691.104550:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789683691.104594:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850296960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683691.104601:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789683691.104625:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850297088 00000100:00100000:2.0:1789683691.104628:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850297088 00000100:00100000:2.0:1789683691.104663:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789683691.104670:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850297088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683691.104690:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683691.104722:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850297088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683691.104728:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789683691.104761:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683691.104817:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850297088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683691.104848:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850296960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683691.110947:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850297216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683691.111020:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683691.111073:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850297216 00000100:00100000:2.0:1789683691.111081:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850297216 00000100:00100000:2.0:1789683691.111134:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789683691.111143:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850297216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683691.111178:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789683691.111243:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850297216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683691.111250:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789683691.111297:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850297216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683691.650889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683691.653508:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835540352 00000100:00100000:2.0:1789683691.653524:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835540352 00000100:00080000:3.0:1789683691.654032:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683691.655050:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 74 00000100:00100000:2.0:1789683691.655067:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+12:15566:x1876618835540352:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789683691.655185:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+12:15566:x1876618835540352:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 Request processed in 123us (4308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683691.655193:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 74 00000100:00100000:3.0:1789683691.670185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683691.670229:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835540480 00000100:00100000:3.0:1789683691.670240:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835540480 00000100:00100000:3.0:1789683691.670299:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 75 00000100:00100000:3.0:1789683691.670309:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:15566:x1876618835540480:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789683691.670409:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:15566:x1876618835540480:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683691.670417:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 75 00000100:00080000:3.0:1789683691.670523:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683691.675700:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683691.675744:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835540736 00000100:00100000:3.0:1789683691.675754:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835540736 00000100:00100000:3.0:1789683691.675829:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789683691.675840:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f897ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+12:15566:x1876618835540736:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789683691.676084:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f897ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+13:15566:x1876618835540736:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 244us (393us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1789683691.676091:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000040:00080000:1.0:1789683691.807496:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789683692.073081:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683692.127428:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683692.127452:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850297344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683692.127525:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683692.127610:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850297344 00000100:00100000:3.0:1789683692.127619:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850297344 00000100:00100000:3.0:1789683692.127689:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683692.127700:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850297344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683692.127737:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789683692.127810:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850297344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683692.127818:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683692.127868:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850297344:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789683692.128150:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683692.569594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683692.569634:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683692.569674:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683692.569888:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683692.569984:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835540864 00000100:00100000:3.0:1789683692.570006:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835540864 00000100:00100000:3.0:1789683692.570061:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 173 00000100:00100000:3.0:1789683692.570081:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2403:x1876618835540864:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683692.570157:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2403:x1876618835540864:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 78us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683692.570165:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 173 00000100:00100000:1.0:1789683692.576284:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683692.576329:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683692.576666:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835541120 00000100:00100000:2.0:1789683692.576678:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835541120 00000100:00100000:2.0:1789683692.576754:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835541376 00000100:00100000:2.0:1789683692.576758:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835541376 00000100:00100000:2.0:1789683692.576802:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835540992 00000100:00100000:2.0:1789683692.576806:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835540992 00000100:00100000:2.0:1789683692.576824:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 90 00000100:00100000:2.0:1789683692.576835:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2403:x1876618835541120:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683692.576935:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2403:x1876618835541120:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 101us (7299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683692.576944:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 90 00000100:00100000:2.0:1789683692.576962:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 91 00000100:00100000:2.0:1789683692.576968:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2403:x1876618835541376:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683692.576991:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2403:x1876618835541376:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (7318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683692.576997:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 91 00000100:00100000:2.0:1789683692.577008:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 92 00000100:00100000:2.0:1789683692.577014:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+13:2403:x1876618835540992:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683692.577037:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+13:2403:x1876618835540992:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (7151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683692.577043:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 92 00000100:00080000:1.0:1789683692.577694:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683692.577727:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835541248 00000100:00100000:1.0:1789683692.577732:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835541248 00000100:00100000:1.0:1789683692.577771:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:1.0:1789683692.577779:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2403:x1876618835541248:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683692.577841:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2403:x1876618835541248:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 64us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683692.577847:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00080000:1.0:1789683692.577862:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683692.578106:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835541504 00000100:00100000:2.0:1789683692.578111:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835541504 00000100:00100000:2.0:1789683692.578142:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 93 00000100:00100000:2.0:1789683692.578149:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2403:x1876618835541504:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683692.578187:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2403:x1876618835541504:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 38us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683692.578193:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 93 00000100:00080000:1.0:1789683692.578504:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789683693.086960:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789683693.166079:0:18704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00000020:00000080:2.0:1789683693.166090:0:18704:0:(genops.c:885:class_export_put()) final put ffff9f0e82d55000/8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00000001:00100000:2.0:1789683693.166120:0:18704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1acf7a90-98f6-4b44-899e-7c61b5867591 00000020:00000080:2.0:1789683693.166122:0:18704:0:(genops.c:885:class_export_put()) final put ffff9f0e82e46000/1acf7a90-98f6-4b44-899e-7c61b5867591 00000020:00000080:1.0:1789683693.166283:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d55000/8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 for lustre-OST0000 00000020:00000080:1.0:1789683693.166347:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82e46000/1acf7a90-98f6-4b44-899e-7c61b5867591 for lustre-OST0000 00000020:00000080:1.0:1789683693.166367:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82d54800 for lustre-OST0000 00000020:00000080:1.0:1789683693.166379:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82e43800 for lustre-OST0000 00000001:00080000:2.0:1789683693.664621:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:2.0:1789683693.664636:0:17180:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1789683693.665062:0:17240:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1789683693.665078:0:17240:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:2.0:1789683694.111891:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683694.175328:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683694.175352:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850297472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683694.175421:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683694.175483:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850297472 00000100:00100000:1.0:1789683694.175490:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850297472 00000100:00100000:1.0:1789683694.175543:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789683694.175553:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850297472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683694.175582:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789683694.175625:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850297472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683694.175642:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789683694.175665:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683694.175714:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850297472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683694.176094:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850297600:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176131:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176170:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850298112:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176195:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176214:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850298624:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176244:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176275:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789683694.176280:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850297728:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176300:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176314:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850298240:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176335:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176350:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850298752:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176366:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176390:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850297984:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176409:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176425:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850298496:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176442:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176458:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850299008:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176476:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176487:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789683694.176492:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850297856:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176512:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176528:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850298368:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176546:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176560:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850298880:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176576:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683694.176597:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850297600 00000100:00100000:3.0:1789683694.176602:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850297600 00000100:00100000:3.0:1789683694.176648:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789683694.176656:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8652d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3647:x1876618850297600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176715:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8652d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3647:x1876618850297600:12345-0@lo:400:kworker.0 Request processed in 60us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.176722:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789683694.176753:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850298112 00000100:00100000:3.0:1789683694.176757:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850298112 00000100:00100000:3.0:1789683694.176780:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850297728 00000100:00100000:3.0:1789683694.176804:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850297728 00000100:00100000:3.0:1789683694.176820:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789683694.176826:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850298112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176857:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850298112:12345-0@lo:400:kworker.0 Request processed in 31us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.176863:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789683694.176873:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683694.176878:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850297728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.176900:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850297728:12345-0@lo:400:kworker.0 Request processed in 23us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.176906:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683694.176922:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850298624 00000100:00100000:3.0:1789683694.176925:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850298624 00000100:00100000:3.0:1789683694.176948:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850298752 00000100:00100000:3.0:1789683694.176951:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850298752 00000100:00100000:3.0:1789683694.176960:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850297984 00000100:00100000:3.0:1789683694.176962:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850297984 00000100:00100000:3.0:1789683694.176972:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850298496 00000100:00100000:3.0:1789683694.176974:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850298496 00000100:00100000:3.0:1789683694.176983:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850299008 00000100:00100000:3.0:1789683694.176985:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850299008 00000100:00100000:3.0:1789683694.176996:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850298880 00000100:00100000:3.0:1789683694.176998:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850298880 00000100:00100000:3.0:1789683694.177022:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789683694.177027:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850298624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177055:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850298624:12345-0@lo:400:kworker.0 Request processed in 28us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.177060:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789683694.177072:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789683694.177077:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850298752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177102:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850298752:12345-0@lo:400:kworker.0 Request processed in 25us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.177107:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789683694.177118:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789683694.177124:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850297984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177153:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850297984:12345-0@lo:400:kworker.0 Request processed in 29us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.177158:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789683694.177171:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789683694.177176:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850298496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177200:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850298496:12345-0@lo:400:kworker.0 Request processed in 25us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.177206:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789683694.177216:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789683694.177221:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850299008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177246:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850299008:12345-0@lo:400:kworker.0 Request processed in 25us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.177252:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789683694.177272:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789683694.177278:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850298880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177307:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850298880:12345-0@lo:400:kworker.0 Request processed in 30us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.177313:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789683694.177337:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850298240 00000100:00100000:3.0:1789683694.177341:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850298240 00000100:00100000:3.0:1789683694.177365:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850297856 00000100:00100000:3.0:1789683694.177368:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850297856 00000100:00100000:3.0:1789683694.177377:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850298368 00000100:00100000:3.0:1789683694.177380:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850298368 00000100:00100000:3.0:1789683694.177393:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789683694.177399:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850298240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177428:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850298240:12345-0@lo:400:kworker.0 Request processed in 29us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.177433:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789683694.177444:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789683694.177449:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850297856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177475:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850297856:12345-0@lo:400:kworker.0 Request processed in 26us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.177481:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789683694.177492:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789683694.177498:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850298368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177523:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850298368:12345-0@lo:400:kworker.0 Request processed in 26us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683694.177528:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789683694.177576:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850297856:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177596:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850298368:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177605:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850298880:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177614:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850297984:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177622:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850298496:0@lo:400:kworker.0 00010000:00080000:3.0:1789683694.177633:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7d85880 x1876618850299008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683694.177644:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850299008:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177695:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850297728:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177706:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850298240:0@lo:400:kworker.0 00010000:00080000:3.0:1789683694.177716:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7de0a80 x1876618850298752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683694.177724:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850298752:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177732:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850297600:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177741:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850298112:0@lo:400:kworker.0 00000100:00100000:3.0:1789683694.177750:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850298624:0@lo:400:kworker.0 00000100:00100000:1.0:1789683694.178852:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683694.178868:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850299136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683694.178915:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789683694.178947:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683694.178951:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683694.178954:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683694.178957:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683694.184569:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850299136 00000100:00100000:1.0:1789683694.184584:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850299136 00000100:00100000:1.0:1789683694.184654:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789683694.184665:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850299136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683694.184702:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789683694.184825:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850299136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 162us (5908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683694.184832:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789683694.184888:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850299136:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1789683694.314377:0:20578:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 18:21:32 (1789683692) 00010000:00010000:0.0:1789683695.136946:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683696.159939:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683696.222976:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850299264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683696.223048:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683696.223212:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850299392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683696.223242:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683696.223273:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850299392 00000100:00100000:1.0:1789683696.223280:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850299392 00000100:00100000:1.0:1789683696.223337:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789683696.223345:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850299392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683696.223381:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789683696.223420:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850299392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683696.223425:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789683696.223446:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683696.223481:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850299392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683696.223529:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850299264 00000100:00100000:2.0:1789683696.223533:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850299264 00000100:00100000:2.0:1789683696.223578:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789683696.223583:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850299264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683696.223606:0:17941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789683696.223655:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850299264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683696.223662:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789683696.223698:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850299264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683696.223860:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850299520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683696.223894:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683696.223972:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850299520 00000100:00100000:1.0:1789683696.223976:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850299520 00000100:00100000:1.0:1789683696.224002:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789683696.224009:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850299520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683696.224027:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683696.224071:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850299520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683696.224078:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789683696.224099:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850299520:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789683696.993504:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789683696.993512:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683696.993537:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789683696.993546:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789683697.186062:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683697.249313:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850299648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683697.249381:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683697.249436:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850299648 00000100:00100000:3.0:1789683697.249443:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850299648 00000100:00100000:3.0:1789683697.249508:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789683697.249516:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850299648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683697.249539:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789683697.249579:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850299648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683697.249587:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789683697.249605:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683697.249651:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850299648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683697.685305:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683697.685382:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683697.685418:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683697.685471:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835542016 00000100:00100000:0.0:1789683697.685482:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835542016 00000100:00100000:0.0:1789683697.685562:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:0.0:1789683697.685574:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2402:x1876618835542016:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683697.685666:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2402:x1876618835542016:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 94us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683697.685674:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00080000:1.0:1789683697.686071:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683697.687856:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683697.687886:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683697.688090:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835541632 00000100:00100000:1.0:1789683697.688100:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835541632 00000100:00100000:1.0:1789683697.688153:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 175 00000100:00100000:1.0:1789683697.688164:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8652ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2402:x1876618835541632:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683697.688235:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8652ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2402:x1876618835541632:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 73us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683697.688242:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 175 00000100:00100000:3.0:1789683697.690446:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835541760 00000100:00100000:3.0:1789683697.690547:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835541760 00000100:00080000:1.0:1789683697.690697:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683697.690775:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835542272 00000100:00100000:3.0:1789683697.690779:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835542272 00000100:00100000:3.0:1789683697.690837:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 100 00000100:00100000:3.0:1789683697.690848:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+12:2402:x1876618835541760:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683697.691003:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 101 00000100:00100000:1.0:1789683697.691014:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835542272:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683697.691095:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+12:2402:x1876618835541760:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 247us (5799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683697.691103:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 100 00000100:00080000:3.0:1789683697.691128:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683697.691325:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835541888 00000100:00100000:0.0:1789683697.691331:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835541888 00000100:00100000:0.0:1789683697.691371:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 102 00000100:00100000:0.0:1789683697.691379:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835541888:12345-192.168.201.50@tcp:400:kworker.0 00000100:00080000:3.0:1789683697.693171:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683697.693256:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835542272:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 2240us (7831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683697.693269:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 101 00000100:00100000:2.0:1789683697.694744:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683697.694961:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835541888:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 3581us (7072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683697.694973:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 102 00000100:00100000:0.0:1789683697.695002:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835542144 00000100:00100000:0.0:1789683697.695011:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835542144 00000100:00080000:2.0:1789683697.695092:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683697.695748:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 103 00000100:00100000:3.0:1789683697.695762:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2402:x1876618835542144:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683697.695867:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2402:x1876618835542144:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 109us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683697.695938:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 103 00010000:00010000:3.0:1789683698.207169:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683699.236850:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683699.296315:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683699.296355:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850299904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683699.296456:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683699.296468:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850299776:0@lo:400:kworker.0 00000100:00100000:3.0:1789683699.296546:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850300032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683699.296706:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683699.296721:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683699.296907:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850299776 00000100:00100000:1.0:1789683699.296919:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850299776 00000100:00100000:0.0:1789683699.296929:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850300416:0@lo:400:kworker.0 00000100:00100000:1.0:1789683699.298513:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789683699.298536:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8652fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3648:x1876618850299776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.304892:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850300288:0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.304976:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683699.305017:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850300800:0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.305043:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683699.305061:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850301312:0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.305082:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683699.305103:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789683699.305109:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850300160:0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.305130:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683699.305348:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850300672:0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.305376:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683699.305395:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850301184:0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.305411:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683699.305442:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850300288 00000100:00100000:2.0:1789683699.305449:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850300288 00000100:00100000:2.0:1789683699.305498:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850300672 00000100:00100000:2.0:1789683699.305500:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850300672 00000100:00100000:2.0:1789683699.305520:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789683699.305527:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850300288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.305579:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850300288:12345-0@lo:400:kworker.0 Request processed in 51us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683699.305595:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789683699.305613:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789683699.305619:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850300672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.305663:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850300672:12345-0@lo:400:kworker.0 Request processed in 45us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683699.305669:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789683699.305686:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850300160 00000100:00100000:2.0:1789683699.305689:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850300160 00000100:00100000:2.0:1789683699.305981:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789683699.305990:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850300160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.306022:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850300160:12345-0@lo:400:kworker.0 Request processed in 35us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683699.306027:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789683699.306050:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850300800 00000100:00100000:2.0:1789683699.306053:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850300800 00000100:00100000:2.0:1789683699.306081:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850301312 00000100:00100000:2.0:1789683699.306083:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850301312 00000100:00100000:2.0:1789683699.306094:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850301184 00000100:00100000:2.0:1789683699.306096:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850301184 00000100:00100000:2.0:1789683699.306106:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789683699.306111:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850300800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.306137:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850300800:12345-0@lo:400:kworker.0 Request processed in 26us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683699.306142:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789683699.306633:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789683699.306659:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850301312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.306688:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789683699.306704:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850301184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683699.306750:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850301312:12345-0@lo:400:kworker.0 Request processed in 103us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683699.306758:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789683699.306817:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850299904 00000100:00100000:3.0:1789683699.306826:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850299904 00000100:00100000:3.0:1789683699.306859:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850300032 00000100:00100000:3.0:1789683699.306862:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850300032 00000100:00100000:3.0:1789683699.306892:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789683699.306898:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850299904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683699.306931:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789683699.306975:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850299904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (10521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683699.306982:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789683699.306997:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683699.307007:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850300032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789683699.307020:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789683699.307024:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850301184:12345-0@lo:400:kworker.0 Request processed in 323us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683699.307035:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1789683699.307063:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683699.307079:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683699.307081:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683699.307084:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683699.307129:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850300160:0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.307142:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850300672:0@lo:400:kworker.0 00000100:00100000:3.0:1789683699.307288:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850300032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 282us (10567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683699.307296:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683699.307351:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850300032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683699.307392:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850299904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683699.307433:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850300544:0@lo:400:kworker.0 00000100:00100000:3.0:1789683699.307476:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683699.307511:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850301056:0@lo:400:kworker.0 00000100:00100000:3.0:1789683699.307534:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683699.307555:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850301056 00000100:00100000:3.0:1789683699.307559:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850301056 00000100:00100000:3.0:1789683699.307620:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789683699.307627:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850301056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683699.307660:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850301056:12345-0@lo:400:kworker.0 Request processed in 34us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683699.307666:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1789683699.307694:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc1c68380 x1876618850301056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683699.307706:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850301056:0@lo:400:kworker.0 00000100:00080000:3.0:1789683699.307751:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683699.307763:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850300544 00000100:00100000:3.0:1789683699.307766:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850300544 00000100:00100000:3.0:1789683699.307820:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789683699.307828:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850300544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683699.307868:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850300544:12345-0@lo:400:kworker.0 Request processed in 41us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683699.308130:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789683699.308237:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850300544:0@lo:400:kworker.0 00000100:00100000:2.0:1789683699.308503:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850301184:0@lo:400:kworker.0 00000100:00100000:0.0:1789683699.309507:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683699.309566:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850300928:0@lo:400:kworker.0 00000100:00100000:0.0:1789683699.309616:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683699.309671:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850300416 00000100:00100000:0.0:1789683699.309680:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850300416 00000100:00100000:0.0:1789683699.309742:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850300928 00000100:00100000:0.0:1789683699.309745:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850300928 00000100:00100000:0.0:1789683699.309990:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789683699.310001:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850300416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683699.310056:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850300416:12345-0@lo:400:kworker.0 Request processed in 57us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683699.310063:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789683699.310083:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789683699.310089:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850300928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683699.310113:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850300928:12345-0@lo:400:kworker.0 Request processed in 25us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683699.310118:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1789683699.310136:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683699.310240:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850300928:0@lo:400:kworker.0 00000100:00100000:0.0:1789683699.310268:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850300416:0@lo:400:kworker.0 00000100:00100000:3.0:1789683699.310540:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850300288:0@lo:400:kworker.0 00000100:00100000:3.0:1789683699.310554:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850300800:0@lo:400:kworker.0 00010000:00080000:3.0:1789683699.310568:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc1c69f80 x1876618850301312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683699.310579:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850301312:0@lo:400:kworker.0 00000100:00100000:1.0:1789683699.317024:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8652fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3648:x1876618850299776:12345-0@lo:400:kworker.0 Request processed in 18480us (20302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683699.317293:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850299776:0@lo:400:kworker.0 00000100:00100000:1.0:1789683699.317640:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789683699.897144:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683699.897289:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835542400 00000100:00100000:1.0:1789683699.897302:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835542400 00000100:00100000:1.0:1789683699.897387:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:1.0:1789683699.897398:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2403:x1876618835542400:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683699.897420:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683699.897456:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb6177c00/0xcf8485587b88ac2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8fc expref: 13 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683699.897478:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683699.897544:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:2403:x1876618835542400:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 147us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683699.897551:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:1.0:1789683699.904809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683699.904871:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683699.905076:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835542528 00000100:00100000:0.0:1789683699.905087:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835542528 00000100:00100000:0.0:1789683699.905162:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:0.0:1789683699.905173:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:2403:x1876618835542528:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683699.905189:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683699.905211:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81676c00/0xcf8485587b88ac32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc92d expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683699.905229:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683699.905283:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:2403:x1876618835542528:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 112us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683699.905304:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:3.0:1789683699.905850:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683699.906129:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835542784 00000100:00100000:2.0:1789683699.906137:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835542784 00000100:00100000:2.0:1789683699.906200:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:2.0:1789683699.906209:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2401:x1876618835542784:12345-192.168.201.50@tcp:9:umount.0 00000020:00000080:2.0:1789683699.906252:0:18710:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ac55 00000020:00010000:2.0:1789683699.906262:0:18710:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9f0e82e44800: total 0 00000100:00080000:2.0:1789683699.906269:0:18710:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e47000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789683699.906333:0:18710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00080000:0.0:1789683699.906570:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683699.906631:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835542912 00000100:00100000:3.0:1789683699.906637:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835542912 00000100:00100000:3.0:1789683699.906685:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:3.0:1789683699.906694:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:2404:x1876618835542912:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683699.906704:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683699.906720:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677c00/0xcf8485587b88acef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9e3 expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683699.906735:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683699.910425:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:2404:x1876618835542912:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 3713us (4557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683699.910446:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000020:00010000:3.0:1789683699.910498:0:17189:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9f0e82e44800: total 0 00010000:00010000:3.0:1789683699.910503:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683699.910563:0:17189:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0e82e44800, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1789683699.910615:0:17189:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789683699.910619:0:17189:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789683682 -> 1789683683 00002000:00010000:3.0:1789683699.910622:0:17189:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789683682 -> 1789683683 00002000:00010000:3.0:1789683699.910640:0:17189:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789683699.910666:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88afc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcac3 expref: 4 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683699.910694:0:17189:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0e82e44800, canceled 1 locks, left on hash table 0. 00000100:00100000:2.0:1789683699.911362:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+3:2401:x1876618835542784:12345-192.168.201.50@tcp:9:umount.0 Request processed in 5151us (6577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683699.911374:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 36 00010000:00010000:3.0:1789683699.912089:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683699.912092:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683699.912094:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683699.932871:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683699.933473:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835543808 00000100:00100000:3.0:1789683699.933486:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835543808 00000100:00100000:3.0:1789683699.933593:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 76 00000100:00100000:3.0:1789683699.933604:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+12:2401:x1876618835543808:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:3.0:1789683699.933648:0:17201:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ac40 00000020:00010000:3.0:1789683699.933666:0:17201:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9f0e825e2800: total 0 00000100:00080000:3.0:1789683699.933672:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9f0e825e0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683699.933713:0:17201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000020:00010000:2.0:1789683699.933886:0:17188:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9f0e825e2800: total 0 00000100:00100000:3.0:1789683699.933941:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+11:2401:x1876618835543808:12345-192.168.201.50@tcp:39:umount.0 Request processed in 338us (1096us total) trans 8589934637 rc 0/0 00010000:00010000:2.0:1789683699.933943:0:17188:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0e825e2800, canceled 0 locks, left on hash table 7. 00000100:00100000:3.0:1789683699.933954:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 76 00010000:00010000:2.0:1789683699.933983:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:2.0:1789683699.933988:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683699.933998:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9ff expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683699.934019:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683699.934022:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683699.934041:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88af11 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca8b expref: 9 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683699.934056:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0fa0118d00) 00010000:00010000:2.0:1789683699.934058:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683699.934062:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b88ad0b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9ea expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683699.934080:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:2.0:1789683699.934082:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789683699.934087:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88adeb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca29 expref: 7 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683699.934103:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683699.934105:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683699.934109:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88afd5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaca expref: 6 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683699.934124:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:2.0:1789683699.934126:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683699.934130:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc3400/0xcf8485587b88af6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa0 expref: 5 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683699.934141:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0fa0118100) 00010000:00010000:2.0:1789683699.934144:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683699.934157:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da400/0xcf8485587b88ad27 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9f1 expref: 4 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683699.934170:0:17188:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0e825e2800, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1789683699.934190:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683699.934192:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683699.934193:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789683699.934314:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683699.963000:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683699.963173:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835543936 00000100:00100000:3.0:1789683699.963184:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835543936 00000100:00100000:3.0:1789683699.963262:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 77 00000100:00100000:3.0:1789683699.963273:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2401:x1876618835543936:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:3.0:1789683699.963308:0:17202:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ac47 00000100:00080000:3.0:1789683699.963327:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9f0e8253e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683699.963363:0:17202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1789683699.963434:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683699.963647:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+3:2401:x1876618835543936:12345-192.168.201.50@tcp:39:umount.0 Request processed in 375us (659us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789683699.963661:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 77 00000100:00080000:0.0:1789683699.963949:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789683700.255001:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683701.024016:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683701.281547:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683701.343363:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850301440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683701.343438:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683701.343502:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683701.343510:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850301568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683701.343536:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683701.343901:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850301568 00000100:00100000:1.0:1789683701.343910:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850301568 00000100:00100000:1.0:1789683701.343968:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789683701.343979:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850301568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683701.344015:0:17941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683701.344065:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850301568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683701.344073:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789683701.344174:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850301568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683701.346690:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850301440 00000100:00100000:0.0:1789683701.346702:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850301440 00000100:00100000:0.0:1789683701.346820:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789683701.346835:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850301440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683701.346869:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789683701.346948:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850301440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (3509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683701.346955:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789683701.347010:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850301440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683701.347379:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850301696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683701.347420:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683701.347580:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850301696 00000100:00100000:1.0:1789683701.347586:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850301696 00000100:00100000:1.0:1789683701.347625:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789683701.347638:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850301696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683701.347661:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789683701.347703:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850301696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683701.347710:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789683701.347773:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850301696:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789683701.347978:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683702.304350:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683702.367176:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683702.367200:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850301824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683702.367284:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683702.367343:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850301824 00000100:00100000:3.0:1789683702.367352:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850301824 00000100:00100000:3.0:1789683702.367422:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683702.367444:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850301824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683702.367467:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1789683702.367563:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683702.367732:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850301824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 301us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683702.367741:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789683702.368103:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850301824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683702.435222:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683702.435271:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683702.435327:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683702.435517:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835544064 00000100:00100000:3.0:1789683702.435537:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835544064 00000100:00100000:3.0:1789683702.435598:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835544320 00000100:00100000:3.0:1789683702.435602:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835544320 00000100:00100000:3.0:1789683702.435615:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835544192 00000100:00100000:3.0:1789683702.435618:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835544192 00000100:00100000:3.0:1789683702.435634:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789683702.435645:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:2405:x1876618835544064:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683702.435665:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683702.435685:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454dc00/0xcf8485587b88ac6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc96c expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683702.435721:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683702.435836:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:2405:x1876618835544064:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 191us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683702.435843:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789683702.435862:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:3.0:1789683702.435869:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:2405:x1876618835544320:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683702.435878:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683702.435888:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837daa00/0xcf8485587b88ace8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9dc expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683702.435898:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683702.435916:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+9:2405:x1876618835544320:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 48us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683702.435921:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:3.0:1789683702.435933:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:3.0:1789683702.435939:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+8:2405:x1876618835544192:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683702.435945:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683702.435953:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88ac71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc99d expref: 8 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683702.435961:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683702.435979:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+7:2405:x1876618835544192:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 40us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683702.435985:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:1.0:1789683702.441893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683702.446445:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835544576 00000100:00100000:3.0:1789683702.446480:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835544576 00000100:00100000:3.0:1789683702.446589:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 78 00000100:00100000:3.0:1789683702.446601:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2401:x1876618835544576:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:3.0:1789683702.446666:0:17201:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ac7f 00000020:00010000:3.0:1789683702.446675:0:17201:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9f0f86d68000: total 0 00000100:00080000:3.0:1789683702.446680:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d54000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683702.446704:0:17201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:2.0:1789683702.446959:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1789683702.447042:0:17189:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9f0f86d68000: total 0 00010000:00010000:1.0:1789683702.447046:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683702.447098:0:17189:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0f86d68000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789683702.447131:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:1.0:1789683702.447135:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683702.447157:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ad74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca06 expref: 6 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683702.447182:0:17189:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0f86d68000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789683702.447193:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683702.447195:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683702.447197:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683702.448543:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+3:2401:x1876618835544576:12345-192.168.201.50@tcp:39:umount.0 Request processed in 1929us (6649us total) trans 8589934638 rc 0/0 00000100:00100000:3.0:1789683702.448556:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 78 00000100:00100000:2.0:1789683702.480474:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683702.480567:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835544704 00000100:00100000:3.0:1789683702.480580:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835544704 00000100:00100000:3.0:1789683702.480663:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 79 00000100:00100000:3.0:1789683702.480674:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2401:x1876618835544704:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:3.0:1789683702.480727:0:17202:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ac86 00000100:00080000:3.0:1789683702.480738:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d51000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683702.480759:0:17202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1789683702.480960:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+3:2401:x1876618835544704:12345-192.168.201.50@tcp:39:umount.0 Request processed in 288us (495us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789683702.480968:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 79 00010000:00010000:2.0:1789683702.481264:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683702.481272:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683702.544024:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683702.544123:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835544960 00000100:00100000:1.0:1789683702.544135:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835544960 00000100:00100000:1.0:1789683702.544214:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 177 00000100:00100000:1.0:1789683702.544226:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8f78f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+7:2401:x1876618835544960:12345-192.168.201.50@tcp:251:umount.0 00000020:00000080:1.0:1789683702.544278:0:17194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ac1d 00000020:00010000:1.0:1789683702.544287:0:17194:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9f0e82e45800: total 0 00000100:00080000:1.0:1789683702.544291:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e41800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789683702.544375:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8f78f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+3:2401:x1876618835544960:12345-192.168.201.50@tcp:251:umount.0 Request processed in 151us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683702.544401:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 177 00000020:00010000:2.0:1789683702.544906:0:17189:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9f0e82e45800: total 0 00010000:00010000:2.0:1789683702.544961:0:17189:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0e82e45800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789683702.544996:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677600/0xcf8485587b88ac24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8f5 expref: 2 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683702.545012:0:17189:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0e82e45800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789683702.545022:0:17189:0:(genops.c:885:class_export_put()) final put ffff9f0e82e45800/d5a4b989-8a1a-4887-96c1-b874fd2dfe72 00010000:00010000:2.0:1789683702.545041:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683702.545044:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683702.545045:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789683702.545095:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82e45800/d5a4b989-8a1a-4887-96c1-b874fd2dfe72 for MGS 00000020:00000080:3.0:1789683702.545139:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82e41800 for MGS 00010000:00010000:2.0:1789683703.342668:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683704.355806:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683704.424938:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850301952:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425059:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850302208:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425124:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.425174:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850302720:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425222:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.425241:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850303232:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425265:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.425285:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850303744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683704.425308:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.425336:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789683704.425343:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850302336:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425363:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.425381:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850302848:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425399:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.425414:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850303360:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425448:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.425477:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850302080:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425512:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.425537:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850302592:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425557:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.425574:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850303104:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425592:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.425608:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850303616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683704.425628:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.425660:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850302208 00000100:00100000:2.0:1789683704.425668:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850302208 00000100:00100000:2.0:1789683704.425718:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850302720 00000100:00100000:2.0:1789683704.425721:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850302720 00000100:00100000:2.0:1789683704.425734:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850302336 00000100:00100000:2.0:1789683704.425742:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850302336 00000100:00100000:2.0:1789683704.425755:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850302848 00000100:00100000:2.0:1789683704.425758:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850302848 00000100:00100000:2.0:1789683704.425770:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789683704.425778:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850302208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425855:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850302208:12345-0@lo:400:kworker.0 Request processed in 77us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683704.425862:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789683704.425880:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789683704.425886:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850302720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.425914:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850302720:12345-0@lo:400:kworker.0 Request processed in 29us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683704.425920:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789683704.425931:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789683704.425937:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850302336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683704.432232:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683704.432296:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850302464:0@lo:400:kworker.0 00000100:00100000:3.0:1789683704.432354:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683704.432386:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850302976:0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.432877:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850302336:0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.432891:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850302208:0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.432903:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850302720:0@lo:400:kworker.0 00000100:00080000:0.0:1789683704.432934:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683704.432940:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683704.432952:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850303744 00000100:00100000:0.0:1789683704.432968:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850303744 00000100:00100000:0.0:1789683704.433002:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850303616 00000100:00100000:0.0:1789683704.433011:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850303616 00000100:00100000:0.0:1789683704.433025:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683704.433032:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876618850303744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683704.433069:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789683704.433116:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876618850303744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (7807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683704.433122:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683704.433139:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789683704.433144:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1876618850303616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683704.433153:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789683704.433177:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1876618850303616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (7548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683704.433182:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789683704.433200:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850303232 00000100:00100000:0.0:1789683704.433203:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850303232 00000100:00100000:0.0:1789683704.433238:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850303360 00000100:00100000:0.0:1789683704.433240:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850303360 00000100:00100000:0.0:1789683704.433250:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850303104 00000100:00100000:0.0:1789683704.433252:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850303104 00000100:00100000:0.0:1789683704.433261:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850302464 00000100:00100000:0.0:1789683704.433263:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850302464 00000100:00100000:0.0:1789683704.433272:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789683704.433277:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850303232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.433306:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850303232:12345-0@lo:400:kworker.0 Request processed in 29us (8041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683704.433311:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789683704.433320:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789683704.433325:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850303360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.433355:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850303360:12345-0@lo:400:kworker.0 Request processed in 30us (7907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683704.433361:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789683704.433371:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789683704.433892:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850303104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.433933:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850303104:12345-0@lo:400:kworker.0 Request processed in 557us (8340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683704.433940:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789683704.434021:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789683704.434029:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850302464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.434078:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850302464:12345-0@lo:400:kworker.0 Request processed in 50us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683704.434084:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789683704.434109:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850302080 00000100:00100000:0.0:1789683704.434114:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850302080 00000100:00100000:0.0:1789683704.434142:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850302592 00000100:00100000:0.0:1789683704.434145:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850302592 00000100:00100000:0.0:1789683704.434157:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789683704.434163:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850302080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.434195:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850302080:12345-0@lo:400:kworker.0 Request processed in 32us (8682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683704.434202:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789683704.434411:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683704.434457:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850303488:0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.434698:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789683704.434713:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850302592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683704.434744:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683704.434747:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850302592:12345-0@lo:400:kworker.0 Request processed in 42us (9189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683704.434763:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789683704.434776:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850302464:0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.434886:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789683704.434896:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850302848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.434931:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850302848:12345-0@lo:400:kworker.0 Request processed in 37us (9532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683704.434936:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789683704.435030:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850302976 00000100:00100000:3.0:1789683704.435093:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850303488 00000100:00100000:3.0:1789683704.435098:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850303488 00000100:00100000:0.0:1789683704.435101:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850302976 00000100:00100000:3.0:1789683704.435125:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789683704.435130:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850302976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683704.435169:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850302976:12345-0@lo:400:kworker.0 Request processed in 38us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683704.435280:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850301952 00000100:00100000:1.0:1789683704.435285:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850301952 00000100:00100000:1.0:1789683704.435311:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789683704.435317:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8f78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3649:x1876618850301952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683704.435351:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8f78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3649:x1876618850301952:12345-0@lo:400:kworker.0 Request processed in 34us (3127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683704.435356:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789683704.435771:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850302336:12345-0@lo:400:kworker.0 Request processed in 9833us (10405us total) trans 0 rc 0/0 00000100:00080000:1.0:1789683704.435840:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683704.435844:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683704.435873:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850302848:0@lo:400:kworker.0 00000100:00100000:1.0:1789683704.435887:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850303360:0@lo:400:kworker.0 00010000:00080000:1.0:1789683704.435902:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7de2a00 x1876618850303232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683704.435911:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850303232:0@lo:400:kworker.0 00000100:00100000:1.0:1789683704.435928:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850303744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683704.436193:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683704.442346:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789683704.442378:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850303488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683704.444349:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850303488:12345-0@lo:400:kworker.0 Request processed in 1981us (9595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683704.444366:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789683704.445920:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850302080:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.445942:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850302592:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.445968:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850303104:0@lo:400:kworker.0 00000100:00100000:2.0:1789683704.445995:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850303616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683704.446424:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789683704.446972:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850301952:0@lo:400:kworker.0 00000100:00100000:3.0:1789683704.446991:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850302976:0@lo:400:kworker.0 00010000:00080000:3.0:1789683704.447005:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7e31880 x1876618850303488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683704.447015:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850303488:0@lo:400:kworker.0 00000020:01000004:0.0:1789683704.808366:0:20773:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789683704.828041:0:20773:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789683704.828100:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.828136:0:20773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.828144:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.828151:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.828169:0:20773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789683704.828175:0:20773:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1789683704.828215:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683704.828222:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.828229:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177800 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683704.828232:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.828241:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683704.828249:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683704.828256:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789683704.828259:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789683704.828261:0:17188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789683704.828299:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.828312:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683704.828345:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.828353:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.828364:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683704.828366:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683704.828368:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683704.828383:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683704.828388:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789683704.828394:0:20773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789683704.828407:0:20773:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdb8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789683704.831469:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850304000:0@lo:39:umount.0 00000100:00100000:0.0:1789683704.831558:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683704.831639:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850304000 00000100:00100000:0.0:1789683704.831648:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850304000 00000100:00100000:0.0:1789683704.831699:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789683704.831708:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876618850304000:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789683704.831735:0:18733:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a811 00000100:00080000:0.0:1789683704.831743:0:18733:0:(import.c:65:import_set_state_nolock()) ffff9f0fc17f7800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789683704.831823:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1876618850304000:12345-0@lo:39:umount.0 Request processed in 115us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683704.831831:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:0.0:1789683704.831845:0:18733:0:(genops.c:885:class_export_put()) final put ffff9f0f8324e000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789683704.831903:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789683704.831912:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8324e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1789683704.832911:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683704.832932:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850303872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683704.832998:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789683704.834038:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdb8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789683704.834052:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850304000:0@lo:39:umount.0 00000100:00080000:2.0:1789683704.834609:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683704.834614:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789683704.834619:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789683704.835142:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc17f7800 for lustre-MDT0000 00010000:00010000:2.0:1789683704.836727:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.836745:0:20773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.836752:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.836758:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.836835:0:20773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683704.836854:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683704.836860:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.836868:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683704.837579:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.837589:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683704.837596:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683704.837602:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789683704.837604:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789683704.837641:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.837647:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683704.837673:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.837680:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.837694:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683704.837696:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683704.837705:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683704.837717:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683704.837735:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850304128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683704.837825:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683704.839038:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850303872 00000100:00100000:3.0:1789683704.839049:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850303872 00000100:00100000:3.0:1789683704.839101:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850304128 00000100:00100000:3.0:1789683704.839105:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850304128 00000100:00100000:3.0:1789683704.839123:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683704.839132:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb794b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+25:3647:x1876618850303872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683704.839159:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683704.839175:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb6177a00/0xcf8485587b88a7e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88a7e0 expref: 25 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683704.839189:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683704.839258:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb794b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3647:x1876618850303872:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (6260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683704.839265:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683704.839318:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683704.839324:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:3650:x1876618850304128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683704.839330:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683704.839339:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb6176400/0xcf8485587b88a738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88a731 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683704.839347:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683704.839374:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:3650:x1876618850304128:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683704.839381:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683704.839422:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850303872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683704.839448:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850304128:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683704.840127:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.840143:0:20773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.840150:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683704.840157:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683704.840531:0:20773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683704.840541:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683704.840549:0:20773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683704.840571:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683704.840578:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683704.840589:0:20773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789683704.840595:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683704.840602:0:20773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683704.840608:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683704.840613:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683704.840621:0:20773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1789683704.840625:0:20773:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789683704.840630:0:20773:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789683704.840665:0:20773:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789683704.840669:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789683704.840674:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683704.840679:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1789683704.840685:0:20773:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0f8a2c1000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683704.840691:0:20773:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0f86d8e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683704.840704:0:20773:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0fc0504800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683704.840708:0:20773:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0fc06b7000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683704.840715:0:20773:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9f0f86d68000 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 192.168.201.50@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1789683704.840720:0:20773:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9f0e825e2800 1acf7a90-98f6-4b44-899e-7c61b5867591 192.168.201.50@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:3.0:1789683704.840725:0:20773:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9f0e837acd40) has exports, disconnecting them 00000020:00080000:3.0:1789683704.840729:0:20773:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0f8a2c1000), last request at 1789683704 00000020:00000080:3.0:1789683704.840735:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ab0c 00000100:00080000:3.0:1789683704.840751:0:20773:0:(import.c:65:import_set_state_nolock()) ffff9f0f8a2c7800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789683704.840823:0:20773:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0f8a2c1000): rc 0 00000020:00000080:3.0:1789683704.840825:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0f8a2c1000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789683704.840838:0:20773:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0f86d8e800), last request at 1789683704 00000020:00000080:3.0:1789683704.840841:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a9b5 00000100:00080000:3.0:1789683704.840846:0:20773:0:(import.c:65:import_set_state_nolock()) ffff9f0f86d8a800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789683704.840853:0:20773:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0f86d8e800): rc 0 00000020:00000080:3.0:1789683704.840855:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0f86d8e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789683704.840859:0:20773:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0fc0504800), last request at 1789683619 00000020:00000080:3.0:1789683704.840862:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a8ff 00000100:00080000:3.0:1789683704.840865:0:20773:0:(import.c:65:import_set_state_nolock()) ffff9f0f86d65800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789683704.840984:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789683704.840991:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841006:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677a00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683704.841009:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841018:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683704.841025:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683704.841030:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789683704.841033:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789683704.841035:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789683704.841065:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841071:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683704.841094:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841101:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841112:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683704.841115:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841121:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683704.841124:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841136:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683704.841142:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683704.841147:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789683704.841149:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789683704.841152:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789683704.841165:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841171:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683704.841185:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841191:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841200:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683704.841328:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841335:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177e00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683704.841338:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841344:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683704.841358:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683704.841362:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789683704.841364:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789683704.841366:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789683704.841379:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841385:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683704.841391:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841398:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841407:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683704.841409:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683704.841410:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683704.841426:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850304256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683704.841484:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683704.841564:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850304384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683704.841588:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683704.841605:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683704.841611:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850304512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683704.841630:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683704.841654:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850304256 00000100:00100000:1.0:1789683704.841661:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850304256 00000100:00100000:1.0:1789683704.841701:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850304384 00000100:00100000:1.0:1789683704.841704:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850304384 00000100:00100000:1.0:1789683704.841716:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850304512 00000100:00100000:1.0:1789683704.841718:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850304512 00000100:00100000:1.0:1789683704.841731:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683704.841739:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3650:x1876618850304256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683704.841750:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683704.841764:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88ab44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88ab3d expref: 24 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.841776:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683704.841828:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:3650:x1876618850304256:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683704.841835:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683704.841851:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789683704.841857:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:3647:x1876618850304384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683704.841864:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:3.0:1789683704.842056:0:20773:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0fc0504800): rc 0 00000020:00000080:3.0:1789683704.842059:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fc0504800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789683704.842066:0:20773:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0fc06b7000), last request at 1789683619 00000020:00000080:3.0:1789683704.842072:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a8a4 00000100:00080000:3.0:1789683704.842078:0:20773:0:(import.c:65:import_set_state_nolock()) ffff9f0fc06b1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683704.842092:0:20773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:3.0:1789683704.842157:0:20773:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0fc06b7000): rc 0 00000004:00000080:3.0:1789683704.842163:0:20773:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba8347913ae0 00000100:00080000:3.0:1789683704.842188:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789683704.842192:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:0.0:1789683704.843736:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8a2c1000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789683704.843811:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f86d8e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789683704.843837:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc0504800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789683704.843857:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f8a2c7800 for lustre-MDT0000 00000020:00000080:0.0:1789683704.843861:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f86d8a800 for lustre-MDT0000 00000020:00000080:0.0:1789683704.843864:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f86d65800 for lustre-MDT0000 00010000:00010000:1.0:1789683704.844163:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da000/0xcf8485587b88ace1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88acda expref: 22 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.844180:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683704.845187:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:3647:x1876618850304384:12345-0@lo:103:ldlm_bl.0 Request processed in 3325us (3593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683704.845199:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789683704.845459:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683704.845536:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683704.845549:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:3647:x1876618850304512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683704.845568:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683704.845586:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837dbe00/0xcf8485587b88a72a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88a723 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683704.845615:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683704.845644:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:3647:x1876618850304512:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (4013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683704.845650:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683704.845698:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850304256:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683704.845721:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683704.846111:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850304512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683704.846119:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850304384:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789683704.846692:0:20773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789683704.846717:0:20773:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789683704.847146:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789683704.847151:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1789683704.847165:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789683704.847244:0:20773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789683704.847256:0:20773:0:(import.c:65:import_set_state_nolock()) ffff9f0e83446000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789683704.847264:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789683704.847266:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1789683704.847275:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789683704.847334:0:20773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789683704.847342:0:20773:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789683704.847383:0:20773:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9f0e837acd40) has no exports 00000100:00100000:1.0:1789683704.847914:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850304640:0@lo:39:umount.0 00000100:00100000:1.0:1789683704.847985:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683704.848019:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850304768:0@lo:9:umount.0 00000100:00100000:1.0:1789683704.848043:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683704.848063:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850304896:0@lo:9:umount.0 00000100:00100000:1.0:1789683704.848081:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683704.848413:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850304768 00000100:00100000:2.0:1789683704.848423:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850304768 00000100:00100000:2.0:1789683704.848527:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850304896 00000100:00100000:2.0:1789683704.848531:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850304896 00000100:00100000:2.0:1789683704.848555:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683704.848564:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876618850304768:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789683704.848594:0:18710:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a9f4 00000100:00080000:2.0:1789683704.848603:0:18710:0:(import.c:65:import_set_state_nolock()) ffff9f0f8721b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789683704.848677:0:18710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789683704.848853:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3646:x1876618850304768:12345-0@lo:9:umount.0 Request processed in 289us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683704.848861:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683704.848893:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789683704.848906:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876618850304896:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789683704.848919:0:18710:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ab4b 00000100:00080000:2.0:1789683704.848926:0:18710:0:(import.c:65:import_set_state_nolock()) ffff9f0e825e1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789683704.848962:0:18710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1789683704.849027:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3646:x1876618850304896:12345-0@lo:9:umount.0 Request processed in 121us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683704.849034:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1789683704.849060:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683704.849066:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683704.849092:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83446000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789683704.849103:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789683704.849105:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789683704.849108:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850304768:0@lo:9:umount.0 00000100:00080000:2.0:1789683704.849118:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789683704.849124:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789683704.849126:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789683704.849128:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850304896:0@lo:9:umount.0 00000100:00100000:0.0:1789683704.851372:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850304640 00000100:00100000:0.0:1789683704.851387:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850304640 00000100:00100000:0.0:1789683704.851455:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789683704.851465:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876618850304640:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789683704.851506:0:17206:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a929 00000100:00080000:0.0:1789683704.851515:0:17206:0:(import.c:65:import_set_state_nolock()) ffff9f0f86d6c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789683704.851538:0:17206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789683704.851705:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3646:x1876618850304640:12345-0@lo:39:umount.0 Request processed in 241us (3719us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789683704.851713:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1789683704.851767:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789683704.851775:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850304640:0@lo:39:umount.0 00010000:00010000:2.0:1789683704.851857:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789683704.865605:0:20773:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9f0e837acd40) has no exports 00000020:00000080:3.0:1789683704.931049:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a77e 00000020:00000080:3.0:1789683704.931068:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0e83d49000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789683704.931091:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789683704.931169:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83d49000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789683704.931200:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683704.931278:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789683704.931300:0:20773:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9f0fa508b380) has no exports 00000020:00000080:0.0:1789683704.931680:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a777 00000020:00000080:0.0:1789683704.931687:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fa5323800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789683704.931770:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa5323800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789683704.932155:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683704.932164:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789683704.932168:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fa5321800/lustre-QMT0000_UUID 00000020:00000080:1.0:1789683704.932171:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa5321800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789683704.932175:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1789683705.375517:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789683705.954996:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789683705.955024:0:17933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1789683705.955029:0:17933:0:(genops.c:885:class_export_put()) final put ffff9f0f86d67000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789683705.955041:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00000001:00080000:1.0:1789683705.955051:0:17933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1789683705.955053:0:17933:0:(genops.c:885:class_export_put()) final put ffff9f0e82d52000/8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00000001:00100000:1.0:1789683705.955058:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1acf7a90-98f6-4b44-899e-7c61b5867591 00000001:00080000:1.0:1789683705.955073:0:17933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1789683705.955075:0:17933:0:(genops.c:885:class_export_put()) final put ffff9f0e8253f000/1acf7a90-98f6-4b44-899e-7c61b5867591 00000020:00000080:0.0:1789683705.955447:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f86d67000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789683705.955514:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d52000/8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 for lustre-MDT0001 00000020:00000080:0.0:1789683705.955536:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e8253f000/1acf7a90-98f6-4b44-899e-7c61b5867591 for lustre-MDT0001 00000020:00000080:0.0:1789683705.955557:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f86d6c800 for lustre-MDT0001 00000020:00000080:0.0:1789683705.955561:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82d51000 for lustre-MDT0001 00000020:00000080:0.0:1789683705.955564:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e8253e000 for lustre-MDT0001 00000001:00100000:3.0:1789683705.955694:0:19524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789683705.955699:0:19524:0:(genops.c:885:class_export_put()) final put ffff9f0e825e2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789683705.955717:0:19524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1acf7a90-98f6-4b44-899e-7c61b5867591 00000020:00000080:3.0:1789683705.955719:0:19524:0:(genops.c:885:class_export_put()) final put ffff9f0e82e44800/1acf7a90-98f6-4b44-899e-7c61b5867591 00000020:00000080:0.0:1789683705.955767:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e825e2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789683705.955819:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82e44800/1acf7a90-98f6-4b44-899e-7c61b5867591 for lustre-OST0001 00000020:00000080:0.0:1789683705.955838:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e825e1800 for lustre-OST0001 00000020:00000080:0.0:1789683705.955843:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82e47000 for lustre-OST0001 00000001:00100000:2.0:1789683705.959667:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789683705.959675:0:17180:0:(genops.c:885:class_export_put()) final put ffff9f0fc06b7000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789683705.959718:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00000001:00080000:2.0:1789683705.959726:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:2.0:1789683705.959729:0:17180:0:(genops.c:885:class_export_put()) final put ffff9f0f86d68000/8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00000001:00100000:2.0:1789683705.959742:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1acf7a90-98f6-4b44-899e-7c61b5867591 00000001:00080000:2.0:1789683705.959747:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:2.0:1789683705.959756:0:17180:0:(genops.c:885:class_export_put()) final put ffff9f0e825e2800/1acf7a90-98f6-4b44-899e-7c61b5867591 00000020:00000080:3.0:1789683705.961551:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc06b7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789683705.961979:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f86d68000/8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 for lustre-MDT0000 00000020:00000080:3.0:1789683705.962141:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e825e2800/1acf7a90-98f6-4b44-899e-7c61b5867591 for lustre-MDT0000 00000020:00000080:3.0:1789683705.962349:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc06b1800 for lustre-MDT0000 00000020:00000080:3.0:1789683705.962355:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82d54000 for lustre-MDT0000 00000020:00000080:3.0:1789683705.962568:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e825e0800 for lustre-MDT0000 00010000:00010000:2.0:1789683706.401848:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683706.469135:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850305024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683706.469206:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683706.469435:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683706.469443:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850305152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683706.469482:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683706.469690:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850305152 00000100:00100000:2.0:1789683706.469700:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850305152 00000100:00100000:2.0:1789683706.469753:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683706.469761:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1876618850305152:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1789683706.469768:0:17205:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789683706.469842:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1876618850305152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (359us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789683706.469849:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:02020000:3.0:1789683706.469953:0:3649:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1789683706.472526:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850305024 00000100:00100000:1.0:1789683706.472541:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850305024 00000100:00100000:1.0:1789683706.472638:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789683706.472646:0:18711:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789683706.472650:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850305024:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683706.472655:0:18711:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1789683706.472696:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789683706.472804:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850305024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (3596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683706.472811:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1789683706.472920:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683706.488519:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789683706.488528:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f0fc04c8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789683706.488533:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789683706.523542:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f0fc04c8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683706.523558:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1789683706.523575:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0fc04c8800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683706.523627:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7e31180 x1876618850305280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683706.523696:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850305024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683706.523823:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850305280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789683706.523888:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683706.524029:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850305280 00000100:00100000:1.0:1789683706.524036:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850305280 00000100:00100000:1.0:1789683706.524077:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789683706.524084:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1876618850305280:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789683706.524100:0:17941:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789683706.526906:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1876618850305280:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 2814us (3010us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789683706.526920:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789683706.527605:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc04c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683706.527613:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789683706.527620:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850305280:0@lo:38:ptlrpcd_00_02.0 00000020:01000000:2.0:1789683706.976833:0:20773:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0f92f5c780 - data ffff9f0fafef8e58/ffff9f0e84594800 00000020:01000000:2.0:1789683706.976995:0:20773:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0fc125e420 - data ffff9f0f8b07fe58/ffff9f0fbffca800 00000001:00000004:2.0:1789683707.002316:0:20773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:2.0:1789683707.083297:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789683707.083307:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789683707.083323:0:20773:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9f0fa7e31880 x1876618850304640/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789683714 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683707.083350:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789683707.084737:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789683707.084742:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1789683707.084989:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789683707.084992:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789683707.085289:0:17224:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789683707.085295:0:17224:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1789683707.085305:0:17224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789683707.086203:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789683707.086208:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1789683707.086267:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789683707.086269:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789683707.086622:0:17226:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789683707.086627:0:17226:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1789683707.086635:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1789683707.088966:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a746 00000020:00000080:0.0:1789683707.088982:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fa513c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789683707.091092:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a75b 00000020:00000080:0.0:1789683707.091107:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fa513b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789683707.091159:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa513c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789683707.091245:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789683707.091251:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683707.091275:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789683707.091280:0:20773:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9f0e837a8000) has no exports 00000004:01000000:0.0:1789683707.091565:0:20773:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789683707.091577:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a7bd 00000020:00000080:0.0:1789683707.091582:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fb240a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789683707.091658:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa513b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789683707.091723:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789683707.091727:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683707.091732:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789683707.091735:0:20773:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9f0fb50499c0) has no exports 00000020:00000080:0.0:1789683707.091741:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a7b6 00000020:00000080:0.0:1789683707.091745:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fb240d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789683707.091757:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb240a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1789683707.092351:0:20773:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789683707.092357:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789683707.092361:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1789683707.092366:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789683707.092370:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789683707.092658:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb240d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789683707.092756:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683707.092763:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789683707.092770:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a7a8 00000020:00000080:0.0:1789683707.092776:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fb240a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789683707.092927:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fb240d000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789683707.092935:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0fb240b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789683707.092937:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb240b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789683707.092955:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789683707.093144:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789683707.093149:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683707.093155:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789683707.093158:0:20773:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9f0e83c2b380) has no exports 00000020:00000080:0.0:1789683707.093163:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a7a1 00000020:00000080:0.0:1789683707.093168:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0e83443000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789683707.093610:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb240a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789683707.093618:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83443000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789683707.094032:0:20773:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789683707.094037:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789683707.094040:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1789683707.094046:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789683707.094048:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789683707.094120:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683707.094136:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1789683707.094150:0:20773:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789683707.094156:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a793 00000020:00000080:0.0:1789683707.094162:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0e83444000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789683707.094228:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e83446000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789683707.094234:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0e83440000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789683707.094236:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83440000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789683707.094240:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789683707.094325:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789683707.094350:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83444000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789683707.094455:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683707.094461:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789683707.094465:0:20773:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff9f0e83c2cd40) has no exports 00000020:00000080:0.0:1789683707.094471:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a78c 00000020:00000080:0.0:1789683707.094475:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0e83d49800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789683707.096461:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83d49800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789683707.096943:0:20773:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1789683707.096949:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789683707.096954:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789683707.096960:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789683707.097004:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683707.097015:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683707.097048:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683707.097051:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683707.097057:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0e82750800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789683707.097060:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82750800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789683707.097067:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683707.097168:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a762 00000020:00000080:1.0:1789683707.097179:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fa513d800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789683707.097183:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789683707.097189:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683707.097196:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789683707.097199:0:20773:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9f0e837ab380) has no exports 00000020:00000080:1.0:1789683707.097226:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683707.097229:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789683707.097233:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a769 00000020:00000080:1.0:1789683707.097247:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fa513a800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789683707.097255:0:20773:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0e83ec0800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789683707.097257:0:20773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0e83ec0800 3 00000020:01000004:1.0:1789683707.097261:0:20773:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0e83ec0800 from lustre-MDT0000 00000020:00000080:1.0:1789683707.097277:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683707.097279:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789683707.097281:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fa513f000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789683707.097283:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa513f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789683707.097289:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789683707.097319:0:20773:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1789683707.097322:0:20773:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789683707.097324:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789683707.097327:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683707.097329:0:20773:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789683707.097334:0:20773:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9f0fb7aa7000 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789683707.097339:0:20773:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9f0fb5048000) has exports, disconnecting them 00000020:00080000:1.0:1789683707.097344:0:20773:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f0fb7aa7000), last request at 1789683604 00000020:00000080:1.0:1789683707.097360:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a70e 00000020:00010000:1.0:1789683707.097363:0:20773:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9f0fb7aa7000: total 2 00000100:00080000:1.0:1789683707.097366:0:20773:0:(import.c:65:import_set_state_nolock()) ffff9f0fb7aa1000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789683707.097374:0:20773:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0fb7aa7000): rc 0 00000020:00080000:1.0:1789683707.097377:0:20773:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9f0fb5048000) has no exports 00000100:00100000:1.0:1789683707.097502:0:17194:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f0fc06c6400:17194] 1 exiting: rc = 0 00000100:00100000:1.0:1789683707.097585:0:17193:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f0e83cc5e00:17193] 0 exiting: rc = 1 00000020:00010000:2.0:1789683707.097736:0:17189:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9f0fb7aa7000: total 2 00010000:00010000:2.0:1789683707.097741:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683707.097870:0:17189:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0fb7aa7000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789683707.097921:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837db600/0xcf8485587b88acc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88acbe expref: 14 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.097950:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88a8ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88a8e3 expref: 13 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.097962:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454cc00/0xcf8485587b88a83b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88a834 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.097976:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88acd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88accc expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.097986:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454d600/0xcf8485587b88a849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88a842 expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.097996:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88aaf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88aaf0 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.098007:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9e00/0xcf8485587b88a71c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88a715 expref: 8 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.098017:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81676200/0xcf8485587b88ab36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88ab2f expref: 7 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.098029:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b88a999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88a992 expref: 6 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.098040:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f8400/0xcf8485587b88aacd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88aac6 expref: 5 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.098048:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837dac00/0xcf8485587b88a96f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88a968 expref: 4 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.098071:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb6176a00/0xcf8485587b88acb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88acb0 expref: 3 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.098081:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da200/0xcf8485587b88a82d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88a826 expref: 2 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683707.098090:0:17189:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0fb7aa7000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1789683707.098104:0:17189:0:(genops.c:885:class_export_put()) final put ffff9f0fb7aa7000/4e5e0833-60b8-4f67-ab09-c7aa3b4baab7 00010000:00010000:2.0:1789683707.098110:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683707.098111:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683707.098113:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789683707.098123:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e83d4f000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789683707.098131:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0e83d4c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789683707.098133:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83d4c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1789683707.098139:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789683707.098176:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa513d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789683707.098180:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0fa513d000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789683707.098181:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa513d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789683707.098184:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1789683707.098206:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa513a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789683707.098210:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb7aa7000/4e5e0833-60b8-4f67-ab09-c7aa3b4baab7 for MGS 00000020:00000080:2.0:1789683707.098237:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fb7aa1000 for MGS 00000100:00100000:2.0:1789683707.100070:0:17195:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f0e83cc4e00:17195] 2 exiting: rc = 0 00000100:00100000:1.0:1789683707.100193:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100204:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100210:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100215:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100225:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100231:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100240:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100246:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100305:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100311:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100316:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100321:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100326:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100331:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100336:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100340:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100345:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100350:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100355:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100360:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100364:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100369:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100374:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100379:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100385:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100399:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100404:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100410:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100415:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100419:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100424:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100429:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100435:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100577:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100592:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100599:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100608:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100613:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100619:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100627:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100637:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100643:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100649:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100663:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100669:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100674:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100679:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100684:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100690:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100696:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100703:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100708:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100717:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100722:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100728:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100734:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100738:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100744:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100752:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100758:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100766:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100772:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100867:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683707.100878:0:20773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789683707.102380:0:20773:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0fb6019b40 - data ffff9f0fafc42948/ffff9f0fa7d80000 00000020:01000000:1.0:1789683707.103081:0:20773:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0e8359e060 - data ffff9f0e820455e8/ffff9f0e82c75800 00000020:00000080:1.0:1789683707.105194:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a6f2 00000020:00000080:1.0:1789683707.105208:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fb7aa2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789683707.105235:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb7aa2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1789683707.105251:0:20773:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0e83ec0800 from MGS, refs=2 00000020:01000004:1.0:1789683707.105255:0:20773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0e83ec0800 2 00000020:01000004:1.0:1789683707.105258:0:20773:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0e83ec0800 from MGS 00000020:00000080:1.0:1789683707.105280:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683707.105287:0:20773:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789683707.105289:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fb7aa3800/MGS 00000020:00000080:1.0:1789683707.105292:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb7aa3800/MGS for MGS 00000020:01000000:1.0:1789683707.105298:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789683707.105380:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789683707.105385:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683707.105390:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789683707.105656:0:20773:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f0f8bdba800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789683707.105663:0:20773:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9f0fb504cd40) has exports, disconnecting them 00000020:00080000:1.0:1789683707.105670:0:20773:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9f0f8bdba800), last request at 1789683604 00000020:00000080:1.0:1789683707.105674:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a7f5 00000020:00080000:1.0:1789683707.105685:0:20773:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0f8bdba800): rc 0 00000020:00000080:1.0:1789683707.105689:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0f8bdba800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789683707.105716:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8bdba800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789683707.107319:0:20773:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789683707.107326:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683707.107330:0:20773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789683707.107336:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789683707.107528:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683707.107537:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789683707.107543:0:20773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0e83ec0800 1 00000020:00000080:2.0:1789683707.107549:0:20773:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a6e4 00000020:00000080:2.0:1789683707.107556:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0fb7aa7800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789683707.107561:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789683707.107566:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683707.107569:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789683707.107572:0:20773:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9f0e8240b380) has no exports 00000020:00000080:2.0:1789683707.129058:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f8bdb8000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789683707.129073:0:14530:0:(genops.c:885:class_export_put()) final put ffff9f0e82752800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789683707.129076:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82752800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789683707.129094:0:14530:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789683707.129753:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb7aa7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789683707.204579:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683707.204595:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789683707.204601:0:20773:0:(genops.c:885:class_export_put()) final put ffff9f0e83ec5000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789683707.204606:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83ec5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789683707.204617:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789683707.204750:0:20773:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0e83ec7800 00000020:02000400:3.0:1789683707.204836:0:20773:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789683707.423951:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683708.447907:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683709.471029:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683709.534969:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683709.534977:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789683709.534997:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0fc04c8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683709.535006:0:499:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 620 00000100:00080000:3.0:1789683709.535012:0:499:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683709.535025:0:499:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0fc04c8800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683709.535050:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7e32680 x1876618850305536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789683709.535224:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850305664:0@lo:400:kworker.0 00000100:00100000:2.0:1789683709.535296:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683709.535352:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850306176:0@lo:400:kworker.0 00000100:00100000:2.0:1789683709.535381:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683709.535440:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789683709.535447:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850305408:0@lo:400:kworker.0 00000400:00000100:2.0:1789683709.535467:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876618850305408 offset 0 length 224: 4 00000100:00100000:2.0:1789683709.535486:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850306048:0@lo:400:kworker.0 00000100:00100000:2.0:1789683709.535507:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683709.535541:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850305664 00000100:00100000:2.0:1789683709.535549:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850305664 00000100:00100000:2.0:1789683709.535622:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789683709.535632:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850305664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683709.535684:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850305664:12345-0@lo:400:kworker.0 Request processed in 53us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683709.535691:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789683709.535737:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850305664:0@lo:400:kworker.0 00000100:00100000:3.0:1789683709.535830:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850306176 00000100:00100000:3.0:1789683709.535835:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850306176 00000100:00100000:3.0:1789683709.535868:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850306048 00000100:00100000:3.0:1789683709.535871:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850306048 00000100:00100000:3.0:1789683709.535886:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789683709.535895:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850306176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683709.535936:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850306176:12345-0@lo:400:kworker.0 Request processed in 43us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683709.535941:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789683709.535955:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789683709.535959:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1876618850306048:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789683709.535965:0:17202:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789683709.535989:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1876618850306048:12345-0@lo:400:kworker.0 Request processed in 28us (480us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789683709.535994:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789683709.536021:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789683709.536025:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d53000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789683709.536029:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789683709.536132:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850305536:0@lo:38:kworker.0 00000100:00100000:0.0:1789683709.536167:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683709.536202:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850305792:0@lo:400:kworker.0 00000100:00100000:0.0:1789683709.536226:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683709.536247:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850306304:0@lo:400:kworker.0 00000100:00100000:0.0:1789683709.536268:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683709.536288:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789683709.536295:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850305920:0@lo:400:kworker.0 00000100:00100000:0.0:1789683709.536315:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683709.536331:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850306432:0@lo:400:kworker.0 00000100:00100000:0.0:1789683709.536351:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789683709.536376:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683709.536381:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683709.536391:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850306304 00000100:00100000:0.0:1789683709.536395:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850306304 00000100:00100000:0.0:1789683709.536425:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850305920 00000100:00100000:0.0:1789683709.536428:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850305920 00000100:00100000:0.0:1789683709.536436:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850306432 00000100:00100000:0.0:1789683709.536438:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850306432 00000100:00100000:0.0:1789683709.536471:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789683709.536477:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850306432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683709.536514:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850306432:12345-0@lo:400:kworker.0 Request processed in 38us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683709.536520:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789683709.536536:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789683709.536540:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1876618850306304:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789683709.536544:0:17201:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789683709.536565:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1876618850306304:12345-0@lo:400:kworker.0 Request processed in 24us (297us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789683709.536571:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789683709.536582:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789683709.536585:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1876618850305920:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789683709.536590:0:17201:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789683709.536609:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1876618850305920:12345-0@lo:400:kworker.0 Request processed in 22us (293us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789683709.536614:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789683709.536632:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850305536 00000100:00100000:0.0:1789683709.536637:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850305536 00000100:00100000:0.0:1789683709.536657:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789683709.536662:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850305536:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789683709.536682:0:17206:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789683709.537978:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850306560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683709.538029:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683709.538076:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850306560 00000100:00100000:2.0:1789683709.538083:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850306560 00000100:00100000:2.0:1789683709.538121:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789683709.538129:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850306560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789683709.538155:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789683709.538199:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850306560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683709.538205:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789683709.538249:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850306560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683709.539877:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850305792 00000100:00100000:2.0:1789683709.539891:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850305792 00000100:00100000:2.0:1789683709.539953:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789683709.539963:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850305792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683709.540041:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850305792:12345-0@lo:400:kworker.0 Request processed in 81us (3814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683709.540049:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1789683709.543868:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683709.543879:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683709.543930:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789683709.543937:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0507800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789683709.543942:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789683709.543949:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0507800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683709.543955:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:1.0:1789683709.543969:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f0fc0507800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683709.544013:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c6aa00 x1876618850306688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683709.544055:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850305920:0@lo:400:kworker.0 00010000:00080000:1.0:1789683709.544074:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f0fa7e31880 x1876618850306432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683709.544086:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850306432:0@lo:400:kworker.0 00000100:00100000:1.0:1789683709.544100:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850305792:0@lo:400:kworker.0 00000100:00080000:1.0:1789683709.544131:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789683709.544134:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e44000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789683709.544137:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789683709.544140:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e44000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683709.544143:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 567 00000100:00080000:1.0:1789683709.544148:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0e82e44000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683709.544160:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c6b800 x1876618850306816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683709.544169:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850306304:0@lo:400:kworker.0 00000100:00100000:2.0:1789683709.544258:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850306688:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789683709.544339:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683709.544378:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850306816:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789683709.544400:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683709.544455:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850306688 00000100:00100000:2.0:1789683709.544462:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850306688 00000100:00100000:2.0:1789683709.544495:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850306816 00000100:00100000:2.0:1789683709.544498:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850306816 00000100:00100000:2.0:1789683709.544515:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789683709.544522:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1876618850306688:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789683709.544543:0:18733:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789683709.544583:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1876618850306688:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 60us (244us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789683709.544590:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789683709.544606:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789683709.544611:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1876618850306816:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789683709.544620:0:18733:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789683709.544640:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1876618850306816:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 28us (239us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789683709.544645:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789683709.544672:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0507800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683709.544677:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789683709.544680:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850306688:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1789683709.544688:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e44000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683709.544691:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789683709.544694:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850306816:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1789683709.555134:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d53000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683709.555145:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 550 00000100:00080000:3.0:1789683709.555181:0:3648:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0e82d53000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683709.555224:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7e31180 x1876618850306944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683709.555258:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850306048:0@lo:400:kworker.0 00000100:00100000:3.0:1789683709.555280:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850306944:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789683709.555356:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683709.555426:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850306944 00000100:00100000:3.0:1789683709.555435:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850306944 00000100:00100000:3.0:1789683709.555479:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789683709.555487:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1876618850306944:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1789683709.555512:0:18733:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789683709.555561:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1876618850306944:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 73us (204us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789683709.555568:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1789683709.555614:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d53000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683709.555619:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789683709.555623:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850306944:0@lo:38:ptlrpcd_00_01.0 00010000:00080000:3.0:1789683709.555657:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f0fa7e30e00 x1876618850306176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683709.555668:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850306176:0@lo:400:kworker.0 00000100:00100000:0.0:1789683709.591592:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850305536:12345-0@lo:38:kworker.0 Request processed in 54917us (55412us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789683709.591609:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1789683709.591778:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc04c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683709.591811:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789683709.591816:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850305536:0@lo:38:kworker.0 00010000:00010000:2.0:1789683710.494984:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789683711.081299:0:18704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789683711.081308:0:18704:0:(genops.c:885:class_export_put()) final put ffff9f0f8721d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789683711.084620:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8721d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789683711.084699:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f8721b800 for lustre-OST0000 00000040:00080000:1.0:1789683711.265192:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1789683711.354574:0:20975:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789683711.371508:0:20975:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789683711.371571:0:20975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.371606:0:20975:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.371615:0:20975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.371622:0:20975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.371650:0:20975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789683711.371656:0:20975:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789683711.371684:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683711.371688:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789683711.371695:0:20975:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789683711.371702:0:20975:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0507800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789683711.371707:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683711.371709:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789683711.371712:0:20975:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789683711.372469:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683711.372480:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683711.372489:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683711.372493:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683711.372503:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683711.372510:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683711.372516:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789683711.372519:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789683711.372522:0:17188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789683711.372563:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683711.372570:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683711.372598:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683711.372605:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683711.372618:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683711.372620:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683711.372621:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683711.372644:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850307072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683711.372726:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683711.372803:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850307072 00000100:00100000:0.0:1789683711.372812:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850307072 00000100:00100000:0.0:1789683711.372850:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789683711.372859:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1876618850307072:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789683711.372866:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789683711 with bad export cookie 14953223277853058830 00010000:00010000:3.0:1789683711.374746:0:20975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374761:0:20975:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374767:0:20975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374773:0:20975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374825:0:20975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683711.374831:0:20975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374836:0:20975:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374842:0:20975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374847:0:20975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374860:0:20975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789683711.374865:0:20975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374871:0:20975:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374876:0:20975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374881:0:20975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374886:0:20975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789683711.374890:0:20975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374901:0:20975:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374906:0:20975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374912:0:20975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683711.374919:0:20975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1789683711.374922:0:20975:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789683711.374954:0:20975:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789683711.374958:0:20975:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789683711.374962:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683711.374968:0:20975:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789683711.374975:0:20975:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9f0e8253a000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683711.374980:0:20975:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9f0f86d8d800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683711.374984:0:20975:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9f0fc1244d40) has exports, disconnecting them 00000020:00080000:3.0:1789683711.374989:0:20975:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f0e8253a000), last request at 1789683709 00000020:00000080:3.0:1789683711.374996:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ab21 00000100:00080000:3.0:1789683711.375016:0:20975:0:(import.c:65:import_set_state_nolock()) ffff9f0e82539800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789683711.375067:0:20975:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0e8253a000): rc 0 00000020:00000080:3.0:1789683711.375069:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0e8253a000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789683711.375079:0:20975:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f0f86d8d800), last request at 1789683709 00000020:00000080:3.0:1789683711.375082:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a9c3 00000100:00080000:3.0:1789683711.375087:0:20975:0:(import.c:65:import_set_state_nolock()) ffff9f0f86d88800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789683711.375097:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e8253a000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789683711.375150:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82539800 for lustre-MDT0001 00000020:00080000:3.0:1789683711.375162:0:20975:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0f86d8d800): rc 0 00000020:00000080:3.0:1789683711.375165:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0f86d8d800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789683711.375175:0:20975:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffba8341cd3ae0 00000020:00000080:3.0:1789683711.375185:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f86d8d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1789683711.375212:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f86d88800 for lustre-MDT0001 00000100:00080000:3.0:1789683711.375231:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683711.375240:0:20975:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9f0e83db4000 x1876618850305152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789683722 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683711.375254:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:1.0:1789683711.375403:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789683711.375411:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375418:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683711.375422:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375430:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683711.375438:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683711.375443:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789683711.375446:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1789683711.375456:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1789683711.375496:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375502:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683711.375522:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375529:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375539:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789683711.375543:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375549:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676e00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683711.375551:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375558:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683711.375563:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683711.375568:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789683711.375570:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789683711.375572:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789683711.375581:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375586:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683711.375598:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375604:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375616:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683711.375619:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375624:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683711.375627:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375632:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683711.375637:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683711.375642:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789683711.375643:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789683711.375645:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789683711.375654:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375659:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683711.375668:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375674:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375690:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683711.375692:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375697:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9a00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683711.375699:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375706:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683711.375711:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683711.375716:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789683711.375718:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789683711.375719:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789683711.375729:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375733:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683711.375739:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375745:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683711.375755:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683711.375757:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683711.375765:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683711.375799:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850307200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683711.375866:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683711.375906:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850305152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683711.375926:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683711.375932:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850307328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683711.375955:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683711.378275:0:20975:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789683711.380636:0:17186:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789683711.380656:0:17186:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789683711.380678:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683711.380741:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850307456:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789683711.381447:0:20975:0:(import.c:65:import_set_state_nolock()) ffff9f0fc04c8800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1789683711.381551:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683711.381601:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683711.381610:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850307584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683711.381638:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789683711.387134:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789683711.387142:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789683711.387164:0:20975:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789683711.387224:0:20975:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789683711.387257:0:20975:0:(import.c:65:import_set_state_nolock()) ffff9f0f8554b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789683711.387903:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789683711.387907:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789683711.387921:0:20975:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789683711.387977:0:20975:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789683711.387990:0:20975:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789683711.388071:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850307712:0@lo:9:umount.0 00000100:00100000:3.0:1789683711.388148:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683711.389105:0:17187:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789683711.389125:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850307200 00000100:00100000:0.0:1789683711.389132:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850307200 00000100:00100000:0.0:1789683711.389163:0:17187:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789683711.389169:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850307328 00000100:00100000:0.0:1789683711.389172:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850307328 00000100:00100000:0.0:1789683711.389180:0:17187:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789683711.389186:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850307456 00000100:00100000:0.0:1789683711.389188:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850307456 00000100:00100000:0.0:1789683711.389196:0:17187:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789683711.389199:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850307584 00000100:00100000:0.0:1789683711.389201:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850307584 00000100:00100000:0.0:1789683711.389719:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1876618850307072:12345-0@lo:103:ldlm_bl.0 Request processed in 16856us (16988us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789683711.389730:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789683711.389771:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789683711.389776:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9f0fb7aa0800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789683711.389781:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00080000:2.0:1789683711.389960:0:20975:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9f0fc1244d40) has no exports 00000100:00100000:3.0:1789683711.391053:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850307840:0@lo:9:umount.0 00000100:00100000:3.0:1789683711.391107:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683711.395032:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850307712 00000100:00100000:1.0:1789683711.395049:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850307712 00000100:00100000:1.0:1789683711.395131:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850307840 00000100:00100000:1.0:1789683711.395135:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850307840 00000100:00100000:1.0:1789683711.395166:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789683711.395177:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876618850307712:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789683711.395208:0:18710:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a9ed 00000100:00080000:1.0:1789683711.395219:0:18710:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0502800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789683711.395265:0:18710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789683711.395450:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3646:x1876618850307712:12345-0@lo:9:umount.0 Request processed in 276us (7302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683711.395458:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789683711.395474:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789683711.395481:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876618850307840:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789683711.395492:0:18710:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ab52 00000100:00080000:1.0:1789683711.395498:0:18710:0:(import.c:65:import_set_state_nolock()) ffff9f0e825e3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789683711.395519:0:18710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1789683711.395594:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3646:x1876618850307840:12345-0@lo:9:umount.0 Request processed in 114us (4488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683711.395617:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789683711.395688:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683711.395692:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683711.395720:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789683711.395733:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789683711.395735:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789683711.395739:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850307840:0@lo:9:umount.0 00000100:00080000:3.0:1789683711.395753:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8554b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789683711.395761:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789683711.395763:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789683711.395765:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850307712:0@lo:9:umount.0 00000100:00080000:0.0:1789683711.396804:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.150@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789683711.396809:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789683711.396816:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fa7e30700 x1876618850305408/t0(0) o400->MGC192.168.201.150@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789683725 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683711.396829:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fb61f0000 x1876618850307072/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789683727 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683711.396850:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc1c68700 x1876618850307200/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789683727 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683711.396865:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc1c6a300 x1876618850307328/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789683727 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683711.396873:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc1c6a680 x1876618850307456/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789683727 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683711.396887:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc1c68380 x1876618850307584/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789683727 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789683711.396895:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789683711.396898:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789683711.396899:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789683711.396902:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9f0fb7aa0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789683711.396906:0:3648:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 518 00000100:00080000:0.0:1789683711.396917:0:3648:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import ffff9f0fb7aa0800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683711.396938:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850307584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683711.396944:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850307456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683711.397192:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7de2300 x1876618850307968/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683711.397216:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850305408:0@lo:400:kworker.0 00000100:00100000:0.0:1789683711.397228:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850307072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683711.397259:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789683711.397266:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1876618850307200:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789683711.397273:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789683711 with bad export cookie 14953223277853058830 00000100:00100000:0.0:1789683711.397326:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1876618850307200:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (21460us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789683711.397340:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789683711.397360:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789683711.397365:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7949050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1876618850307328:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683711.397665:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3646:1876618850307968:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1789683711.397702:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876618850307968 offset 0 length 520: 4 00010000:00020000:0.0:1789683711.397825:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789683711 with bad export cookie 14953223277853058830 00000100:00100000:0.0:1789683711.397869:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7949050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1876618850307328:12345-0@lo:103:ldlm_bl.0 Request processed in 502us (21912us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789683711.397876:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789683711.397917:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789683711.397922:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1876618850307456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789683711.397927:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789683711 with bad export cookie 14953223277853058830 00000400:00000100:0.0:1789683711.397943:0:17185:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876618850307456 offset 224 length 224: 4 00000100:00100000:0.0:1789683711.397955:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1876618850307456:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (16403us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789683711.397960:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789683711.397972:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789683711.397976:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1876618850307584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789683711.397980:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789683711 with bad export cookie 14953223277853058830 00000400:00000100:0.0:1789683711.397993:0:17185:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876618850307584 offset 224 length 224: 4 00000100:00100000:0.0:1789683711.398002:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1876618850307584:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (16364us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789683711.398007:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1789683711.398632:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683711.398654:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850307328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683711.398664:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850307200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683711.398685:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789683711.403395:0:20975:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9f0fc1244d40) has no exports 00000020:01000000:0.0:1789683711.471559:0:20975:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0e8267e060 - data ffff9f0fafeb7a20/ffff9f0e83651400 00000020:01000000:0.0:1789683711.471756:0:20975:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0f92f5cd80 - data ffff9f0fafef9288/ffff9f0f86c99800 00000001:00000004:0.0:1789683711.482718:0:20975:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00010000:00010000:1.0:1789683711.518928:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683711.553043:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683711.553053:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789683711.553061:0:20975:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789683711.555010:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789683711.555017:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789683711.555036:0:20975:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789683711.555039:0:20975:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789683711.555355:0:17942:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789683711.555388:0:17942:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1789683711.555400:0:17942:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789683711.556291:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789683711.556295:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789683711.556353:0:20975:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789683711.556356:0:20975:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789683711.557081:0:17944:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789683711.557087:0:17944:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1789683711.557096:0:17944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789683711.559410:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a857 00000020:00000080:3.0:1789683711.559424:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0f8303f000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789683711.559559:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8303f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789683711.560925:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a86c 00000020:00000080:3.0:1789683711.560935:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0fc06a7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789683711.561110:0:20975:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789683711.561117:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683711.561126:0:20975:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789683711.561131:0:20975:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9f0fc12419c0) has no exports 00000020:00000080:1.0:1789683711.561138:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc06a7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1789683711.561303:0:20975:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789683711.561314:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a8c0 00000020:00000080:3.0:1789683711.561396:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0f8a2c5000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789683711.561447:0:20975:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789683711.561452:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683711.561456:0:20975:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789683711.561459:0:20975:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9f0e83c299c0) has no exports 00000020:00000080:3.0:1789683711.561465:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a8b9 00000020:00000080:3.0:1789683711.561469:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0e83d4e000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789683711.561491:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8a2c5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1789683711.561981:0:20975:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789683711.561986:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789683711.562015:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789683711.562022:0:20975:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789683711.562025:0:20975:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789683711.562127:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83d4e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789683711.562272:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683711.562281:0:20975:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789683711.562288:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a8ab 00000020:00000080:3.0:1789683711.562295:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0e82d9d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789683711.562317:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f8bdbd000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789683711.562335:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0e82d98000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789683711.562338:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d98000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789683711.562343:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789683711.562629:0:20975:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789683711.562634:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683711.562639:0:20975:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789683711.562643:0:20975:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9f0e8240cd40) has no exports 00000020:00000080:3.0:1789683711.562649:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a89d 00000020:00000080:3.0:1789683711.562653:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0f8554e800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789683711.562668:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d9d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:3.0:1789683711.563117:0:20975:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789683711.563121:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789683711.563124:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789683711.563128:0:20975:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789683711.563130:0:20975:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789683711.563283:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8554e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789683711.563443:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683711.563451:0:20975:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789683711.563467:0:20975:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789683711.563474:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a88f 00000020:00000080:3.0:1789683711.563479:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0e82757800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789683711.563507:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f8554b800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789683711.563515:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0e82d98800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789683711.563517:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d98800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789683711.563597:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789683711.563730:0:20975:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789683711.563735:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683711.563740:0:20975:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789683711.563744:0:20975:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9f0e82408000) has no exports 00000020:00000080:3.0:1789683711.563749:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a888 00000020:00000080:3.0:1789683711.563753:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0fc04ce000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789683711.563823:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82757800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789683711.564064:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc04ce000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789683711.584822:0:20975:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1789683711.584831:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683711.584837:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789683711.584858:0:20975:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789683711.584920:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683711.584934:0:20975:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789683711.584957:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc04c8800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789683711.584976:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0e81fac800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789683711.584980:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e81fac800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789683711.584991:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789683711.585072:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683711.585078:0:20975:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789683711.585082:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0f8554a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789683711.585085:0:20975:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8554a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789683711.585092:0:20975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789683711.585223:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a873 00000020:00000080:3.0:1789683711.585231:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0fc06a5000/lustre-MDD0001_UUID 00000020:01000000:3.0:1789683711.585248:0:20975:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1789683711.585252:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683711.585257:0:20975:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789683711.585261:0:20975:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9f0fc1240000) has no exports 00000020:00000080:3.0:1789683711.585280:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683711.585283:0:20975:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1789683711.585287:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a87a 00000020:00000080:3.0:1789683711.585290:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0fc06a6800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1789683711.585298:0:20975:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0fc04cf800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1789683711.585301:0:20975:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fc04cf800 2 00000020:01000004:3.0:1789683711.585304:0:20975:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0fc04cf800 from lustre-MDT0001 00000020:00000080:3.0:1789683711.585320:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683711.585323:0:20975:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1789683711.585326:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0f8303e000/lustre-MDT0001_UUID 00000020:00000080:3.0:1789683711.585328:0:20975:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8303e000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1789683711.585336:0:20975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1789683711.585376:0:20975:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1789683711.585380:0:20975:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1789683711.585384:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683711.585387:0:20975:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789683711.585394:0:20975:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9f0fc0501000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683711.585408:0:20975:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9f0fa50899c0) has exports, disconnecting them 00000020:00080000:3.0:1789683711.585412:0:20975:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9f0fc0501000), last request at 1789683619 00000020:00000080:3.0:1789683711.585416:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a8f8 00000020:00080000:3.0:1789683711.585422:0:20975:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0fc0501000): rc 0 00000020:00000080:3.0:1789683711.585426:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0fc0501000/lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1789683711.586101:0:20975:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1789683711.586106:0:20975:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683711.586109:0:20975:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789683711.586115:0:20975:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789683711.586246:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683711.586251:0:20975:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1789683711.586256:0:20975:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fc04cf800 1 00000020:00000080:3.0:1789683711.586260:0:20975:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a81f 00000020:00000080:3.0:1789683711.586265:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0fc17f5800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1789683711.586269:0:20975:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1789683711.586274:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683711.586277:0:20975:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789683711.586280:0:20975:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9f0e824099c0) has no exports 00000020:00000080:0.0:1789683711.586399:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc06a5000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789683711.586406:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0fa5327800/lustre-MDD0001_UUID 00000020:00000080:0.0:1789683711.586408:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa5327800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1789683711.586413:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1789683711.586593:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc06a6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789683711.586603:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc0501000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789683711.586613:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc0507800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789683711.586627:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0fc0503000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789683711.586629:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc0503000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789683711.586637:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789683711.586690:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc17f5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789683711.760099:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683711.760112:0:20975:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789683711.760118:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0fc04ca000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789683711.760123:0:20975:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc04ca000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789683711.760135:0:20975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789683711.760254:0:20975:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0fc04ca800 00000020:01000000:2.0:1789683711.760285:0:20975:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789683711.760289:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683711.760293:0:20975:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789683711.760298:0:20975:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9f0e837a99c0) has no exports 00000100:00100000:3.0:1789683711.760519:0:17202:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9f0f845b3800:17202] 2 exiting: rc = 0 00000100:00100000:3.0:1789683711.760635:0:18733:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9f0e837cca00:18733] 3 exiting: rc = 0 00000100:00100000:3.0:1789683711.760704:0:17200:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9f0f845b3a00:17200] 0 exiting: rc = 1 00000100:00100000:3.0:1789683711.760777:0:17201:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9f0f845b2800:17201] 1 exiting: rc = 0 00000100:00100000:2.0:1789683711.762058:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762067:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762075:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762081:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762087:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762093:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762099:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762104:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762110:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762116:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762122:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762127:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762133:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762138:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762143:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762148:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762153:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762159:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762166:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762172:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762180:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762186:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762193:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762198:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762270:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762279:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762284:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762292:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762297:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762302:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762307:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762520:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762526:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762533:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762539:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762545:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.762552:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765329:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765340:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765346:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765352:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765359:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765377:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765383:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765389:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765395:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765400:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765406:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765412:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765417:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765424:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765430:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765436:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765442:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765448:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765453:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765458:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765464:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765470:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765477:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765482:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765489:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765494:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.765501:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.776992:0:17203:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9f0fa53cac00:17203] 0 exiting: rc = 1 00000100:00100000:0.0:1789683711.777234:0:17204:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9f0f82b95a00:17204] 1 exiting: rc = 0 00000100:00100000:3.0:1789683711.781127:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.781139:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.781146:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.781152:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.781158:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.781163:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.781169:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.781173:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.781178:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.781199:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.781204:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.781209:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783384:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783390:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783396:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783401:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783407:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783411:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783416:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783421:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783427:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783432:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783436:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783441:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783446:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783453:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783458:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783463:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783469:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783474:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783479:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783485:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783491:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783496:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783501:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783506:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783512:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783517:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783523:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783528:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783533:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.783550:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784106:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784117:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784143:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784148:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784153:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784159:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784167:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784174:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784179:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784184:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784190:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784195:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784200:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784267:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784275:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784281:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784286:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784291:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784295:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784300:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784304:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.784465:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683711.788819:0:17206:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9f0fa53ca200:17206] 1 exiting: rc = 0 00000100:00100000:1.0:1789683711.789013:0:17941:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9f0f8aa91c00:17941] 2 exiting: rc = 0 00000100:00100000:3.0:1789683711.796164:0:17205:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9f0f856a4200:17205] 0 exiting: rc = 1 00000100:00100000:1.0:1789683711.796345:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796359:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796376:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796384:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796391:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796398:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796404:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796410:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796419:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796424:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796430:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796447:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796455:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796462:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796468:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796473:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796479:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796486:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796511:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796518:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796524:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796530:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796536:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796566:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796574:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796580:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796586:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796593:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796599:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796605:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796610:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796616:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796624:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796631:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.796637:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798334:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798352:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798358:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798374:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798383:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798390:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798397:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798404:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798416:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798422:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798428:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798434:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798457:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798464:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798472:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798481:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798487:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798493:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798515:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798521:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798527:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798533:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798539:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798545:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798720:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798729:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798735:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798741:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683711.798748:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.827713:0:17208:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9f0f856a5400:17208] 1 exiting: rc = 0 00000100:00100000:1.0:1789683711.830131:0:17207:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9f0e81ca6800:17207] 0 exiting: rc = 1 00000100:00100000:2.0:1789683711.830262:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830270:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830276:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830281:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830288:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830294:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830299:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830303:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830320:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830326:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830332:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830338:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830343:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830349:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830354:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830359:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830374:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830379:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830384:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830388:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830394:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830399:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830404:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830409:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830415:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830420:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830426:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830431:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830436:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830441:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830447:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830452:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830458:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830463:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830468:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830489:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830495:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830501:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830507:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830512:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830517:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830524:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830530:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830535:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830540:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830545:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830550:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830566:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830572:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830577:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830583:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830588:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830593:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830598:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830603:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830608:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830613:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830618:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830623:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830627:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830632:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830636:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830641:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.830654:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683711.831411:0:17210:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9f0f845f1400:17210] 1 exiting: rc = 0 00000100:00100000:1.0:1789683711.831988:0:17209:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9f0f8619d600:17209] 0 exiting: rc = 1 00000100:00100000:2.0:1789683711.832076:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832084:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832089:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832094:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832099:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832104:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832124:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832130:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832135:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832141:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832146:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832152:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832158:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832163:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832168:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832174:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832179:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832185:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832190:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832195:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832200:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832217:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832222:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832226:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832231:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832237:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832242:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832247:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832252:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832257:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832263:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832268:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832274:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832279:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832285:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832290:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832295:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832300:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832304:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832319:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832326:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832337:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832342:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832346:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832351:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832355:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832371:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832377:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832381:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832386:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832392:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832397:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832401:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832406:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832411:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832416:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832422:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832427:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832433:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832437:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832442:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832447:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832452:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.832457:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.833445:0:17211:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9f0f845f1600:17211] 0 exiting: rc = 1 00000100:00100000:0.0:1789683711.836034:0:17212:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9f0f8619ce00:17212] 1 exiting: rc = 0 00000100:00100000:2.0:1789683711.836750:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.836758:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.836765:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.836769:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.836774:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.836780:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.836806:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.836812:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.836816:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837231:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837242:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837267:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837273:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837278:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837283:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837289:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837293:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837298:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837302:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837307:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837323:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837328:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837333:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837338:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837343:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837347:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837352:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837357:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837372:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837378:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837383:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837389:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837393:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837399:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837404:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837411:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837416:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837422:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837427:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837433:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837437:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837443:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837448:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837453:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837457:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837462:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837475:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837481:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837486:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837491:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837496:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837502:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837508:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837513:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837518:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837522:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837529:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837534:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837540:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837546:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837562:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837569:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837574:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.837580:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.838480:0:17213:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9f0fc0bd7a00:17213] 0 exiting: rc = 1 00000100:00100000:0.0:1789683711.839147:0:17214:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9f0fc0bd7e00:17214] 1 exiting: rc = 0 00000100:00100000:0.0:1789683711.839421:0:17215:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9f0fc04c7200:17215] 2 exiting: rc = 0 00000100:00100000:2.0:1789683711.839536:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839544:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839568:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839613:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839621:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839627:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839632:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839638:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839643:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839775:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839807:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839815:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839821:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839895:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839901:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839907:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839932:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839938:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839944:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.839951:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840029:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840037:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840043:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840048:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840053:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840058:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840064:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840085:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840091:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840096:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840102:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840107:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840112:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840118:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840123:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840129:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840134:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840140:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840145:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840152:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840156:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840162:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840168:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840174:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840179:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840185:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840191:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840196:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840273:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840282:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840288:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840507:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840515:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840521:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840527:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840532:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840538:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840544:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840550:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840766:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840773:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840778:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840904:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683711.840912:0:20975:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789683711.856332:0:20975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683711.856346:0:20975:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789683711.856352:0:20975:0:(genops.c:885:class_export_put()) final put ffff9f0e82751000/MDS_uuid 00000020:00000080:3.0:1789683711.856357:0:20975:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82751000/MDS_uuid for MDS 00000020:01000000:3.0:1789683711.856378:0:20975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789683711.856598:0:20975:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789683712.548431:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683713.568707:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683714.593860:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683714.655226:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789683714.655236:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683714.655240:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789683714.655243:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789683714.655247:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d53000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683714.655256:0:499:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 623 00000100:00080000:2.0:1789683714.655262:0:499:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789683714.655273:0:499:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0e82d53000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683714.655322:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83db4e00 x1876618850308096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683714.655383:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789683714.655388:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789683714.655389:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e44000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683714.655393:0:499:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 623 00000100:00080000:2.0:1789683714.655396:0:499:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789683714.655419:0:499:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0e82e44000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683714.655432:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83db6300 x1876618850308352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683714.655512:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850308224:0@lo:400:kworker.0 00000400:00000100:0.0:1789683714.655584:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850308224 offset 0 length 224: 4 00000100:00100000:0.0:1789683714.655624:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683714.655630:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850308480:0@lo:400:kworker.0 00000400:00000100:0.0:1789683714.655647:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850308480 offset 0 length 224: 4 00000100:00100000:3.0:1789683714.656200:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850308096:0@lo:38:kworker.0 00000400:00000100:3.0:1789683714.656227:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850308096 offset 0 length 520: 4 00000100:00100000:3.0:1789683714.656243:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850308352:0@lo:38:kworker.0 00000400:00000100:3.0:1789683714.656256:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850308352 offset 0 length 520: 4 00010000:00010000:1.0:1789683715.634145:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789683716.594367:0:21178:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789683716.617632:0:21178:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789683716.617722:0:21178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683716.617907:0:21178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683716.617916:0:21178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683716.617924:0:21178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683716.617998:0:21178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789683716.618005:0:21178:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789683716.618039:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789683716.618071:0:21178:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0e83db4e00 x1876618850308096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789683729 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683716.618098:0:21178:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789683716.618107:0:21178:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789683716.618115:0:21178:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d53000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789683716.618122:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789683716.618126:0:21178:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0e83db4e00 x1876618850308096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789683729 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683716.618133:0:21178:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789683716.618137:0:21178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1789683716.618227:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850308096:0@lo:38:kworker.0 00000100:00080000:1.0:1789683716.619292:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789683716.619306:0:21178:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0e83db7800 x1876618850308224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683730 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683716.619330:0:21178:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789683716.619336:0:21178:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789683716.619386:0:21178:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d56800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789683716.619497:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850308224:0@lo:400:kworker.0 00000100:00100000:0.0:1789683716.619813:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1876618850308608:0@lo:39:umount.0 00000400:00000100:0.0:1789683716.619880:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850308608 offset 0 length 224: 4 00010000:00010000:3.0:1789683716.620548:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683716.620638:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683716.620651:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683716.620656:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683716.620668:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683716.620675:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683716.620682:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789683716.620685:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789683716.620689:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789683716.620709:0:17189:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fb7aa0800 00010000:00010000:3.0:1789683716.620714:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683716.620720:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683716.620916:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683716.620919:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683716.620922:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683716.639714:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683716.703953:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789683716.703965:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683716.703968:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789683716.703972:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789683716.704049:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850308736:0@lo:400:kworker.0 00000400:00000100:2.0:1789683716.704125:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850308736 offset 0 length 224: 4 00000001:00100000:0.0:1789683716.707200:0:19524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789683716.707247:0:19524:0:(genops.c:885:class_export_put()) final put ffff9f0e825e4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789683716.707349:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e825e4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789683716.707430:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e825e3800 for lustre-OST0001 00000001:00100000:2.0:1789683716.708417:0:18704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789683716.708424:0:18704:0:(genops.c:885:class_export_put()) final put ffff9f0fc0500000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789683716.708514:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc0500000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789683716.708583:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc0502800 for lustre-OST0000 00010000:00010000:3.0:1789683717.664243:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683718.687328:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683719.711540:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789683719.711581:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789683719.711590:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683719.711594:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789683719.711597:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789683719.711713:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683719.711745:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850308864:0@lo:400:kworker.0 00000400:00000100:2.0:1789683719.711848:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850308864 offset 0 length 224: 4 00010000:00010000:1.0:1789683720.737366:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683721.759145:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683711/real 1789683711] req@ffff9f0fa7de2300 x1876618850307968/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789683721 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683721.759202:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fa7de2300 x1876618850307968/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789683721 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683721.759227:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb7aa0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683721.759282:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789683721.759287:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3646:1876618850307968:0@lo:250:ptlrpcd_00_01.0 00010000:00010000:3.0:1789683721.759376:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789683721.759376:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789683721.759388:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789683721.759392:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fb7aa0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683721.759398:0:36:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 625 00000100:00080000:1.0:1789683721.759404:0:36:0:(import.c:630:import_select_connection()) MGC192.168.201.150@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789683721.759419:0:36:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import ffff9f0fb7aa0800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683721.759457:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c6a300 x1876618850308992/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683721.759484:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789683721.759489:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789683721.759561:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850309120:0@lo:400:kworker.0 00000100:00100000:0.0:1789683721.759592:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3646:1876618850308992:0@lo:250:kworker.0 00000400:00000100:2.0:1789683721.759630:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850309120 offset 0 length 224: 4 00000400:00000100:0.0:1789683721.774577:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876618850308992 offset 0 length 520: 4 00010000:00010000:3.0:1789683722.783266:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683723.811856:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683724.832721:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683725.855170:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683726.879006:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683716/real 1789683716] req@ffff9f0fc1c6bb80 x1876618850308608/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683726 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683726.879066:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fc1c6bb80 x1876618850308608/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683726 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683726.879121:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d56800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789683726.879149:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1876618850308608:0@lo:39:umount.0 00000100:00080000:1.0:1789683726.879274:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789683726.879281:0:21178:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789683726.879287:0:21178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789683726.880948:0:21178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683726.880969:0:21178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683726.880978:0:21178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683726.880986:0:21178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683726.881020:0:21178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683726.881038:0:21178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683726.881071:0:21178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683726.881078:0:21178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683726.881084:0:21178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683726.881105:0:21178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789683726.881111:0:21178:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789683726.881148:0:21178:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789683726.881153:0:21178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789683726.881159:0:21178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683726.881166:0:21178:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789683726.881171:0:21178:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9f0fa508cd40) has no exports 00000020:00080000:1.0:1789683726.881203:0:21178:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9f0fa508cd40) has no exports 00010000:00010000:0.0:1789683726.881848:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683726.881861:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683726.881872:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c800 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683726.881876:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683726.881887:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683726.881895:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683726.881902:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789683726.881905:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789683726.881920:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789683726.881940:0:17189:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fb7aa0800 00010000:00010000:0.0:1789683726.881946:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683726.881954:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683726.881973:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683726.881978:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683726.881984:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176800 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683726.881987:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683726.881994:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683726.882001:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683726.882007:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789683726.882021:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789683726.882030:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789683726.882037:0:17189:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fb7aa0800 00010000:00010000:0.0:1789683726.882041:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683726.882048:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683726.882072:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683726.882074:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683726.882076:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683726.883138:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789683726.886695:0:21178:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0fb6019de0 - data ffff9f0fafd92948/ffff9f0fa7d81c00 00000020:01000000:1.0:1789683726.887770:0:21178:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0e82fa7540 - data ffff9f0fafc63288/ffff9f0e81f62400 00100000:10000000:1.0:1789683726.897194:0:21178:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789683726.925389:0:21178:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a97d 00000020:00000080:0.0:1789683726.925413:0:21178:0:(genops.c:885:class_export_put()) final put ffff9f0fc0503800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789683726.927177:0:21178:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0fc06b1000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789683726.927186:0:21178:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fc06b1000 2 00000020:01000004:3.0:1789683726.927191:0:21178:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0fc06b1000 from lustre-OST0000 00000020:00000080:3.0:1789683726.927229:0:21178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683726.927243:0:21178:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789683726.927249:0:21178:0:(genops.c:885:class_export_put()) final put ffff9f0f8a2c4800/lustre-OST0000_UUID 00000020:00000080:3.0:1789683726.927252:0:21178:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8a2c4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789683726.927267:0:21178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789683726.927370:0:21178:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789683726.927375:0:21178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789683726.927378:0:21178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683726.927383:0:21178:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789683726.927389:0:21178:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9f0e82d50800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683726.927396:0:21178:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9f0fa5088000) has exports, disconnecting them 00000020:00080000:3.0:1789683726.927401:0:21178:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9f0e82d50800), last request at 1789683636 00000020:00000080:3.0:1789683726.927405:0:21178:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a9a7 00000020:00080000:3.0:1789683726.927424:0:21178:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0e82d50800): rc 0 00000020:00000080:3.0:1789683726.927429:0:21178:0:(genops.c:885:class_export_put()) final put ffff9f0e82d50800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789683726.928712:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc0503800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789683726.934276:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d50800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789683726.934332:0:21178:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789683726.934338:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683726.934344:0:21178:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789683726.934351:0:21178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789683726.934858:0:21178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683726.934872:0:21178:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789683726.934882:0:21178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789683726.934888:0:21178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683726.934894:0:21178:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789683726.934902:0:21178:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9f0e82d53800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789683726.934910:0:21178:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff9f0fc04d8000) has exports, disconnecting them 00000020:00080000:2.0:1789683726.934915:0:21178:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9f0e82d53800), last request at 1789683636 00000020:00000080:2.0:1789683726.934921:0:21178:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a9bc 00000020:00080000:2.0:1789683726.934942:0:21178:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0e82d53800): rc 0 00000020:00000080:2.0:1789683726.934948:0:21178:0:(genops.c:885:class_export_put()) final put ffff9f0e82d53800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789683726.935039:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82d53000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789683726.935049:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0f8a2c5800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789683726.935052:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8a2c5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789683726.935068:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789683726.935640:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d53800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789683726.939863:0:21178:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789683726.939876:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789683726.939881:0:21178:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789683726.939890:0:21178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789683726.939932:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82d56800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789683726.940150:0:21178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683726.940163:0:21178:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789683726.940171:0:21178:0:(genops.c:885:class_export_put()) final put ffff9f0e82d56000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789683726.940179:0:21178:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d56000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789683726.940186:0:21178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789683726.940287:0:21178:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fc06b1000 1 00000020:00000080:0.0:1789683726.940295:0:21178:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a95a 00000020:00000080:0.0:1789683726.940303:0:21178:0:(genops.c:885:class_export_put()) final put ffff9f0f86d6d800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789683726.940313:0:21178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789683726.940321:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f86d6d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789683726.940330:0:21178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683726.940336:0:21178:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789683726.940340:0:21178:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff9f0fc1243380) has no exports 00000100:00080000:0.0:1789683726.952896:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789683726.952920:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683726.952924:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789683726.952939:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789683726.981729:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850309248:0@lo:400:kworker.0 00000400:00000100:3.0:1789683726.981848:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850309248 offset 0 length 224: 4 00000020:00000080:0.0:1789683726.996574:0:21178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683726.996595:0:21178:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789683726.996604:0:21178:0:(genops.c:885:class_export_put()) final put ffff9f0fc06b2800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789683726.996610:0:21178:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc06b2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789683726.996623:0:21178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789683726.998000:0:21178:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0fc06b3000 00000020:02000400:0.0:1789683726.998275:0:21178:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789683727.904012:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683728.960334:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683729.950875:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683714/real 1789683714] req@ffff9f0e83db6300 x1876618850308352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789683729 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683729.950908:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0e83db6300 x1876618850308352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789683729 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683729.950928:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e44000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683729.950947:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789683729.950951:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850308352:0@lo:38:kworker.0 00000100:00080000:2.0:1789683729.951095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789683729.951101:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683729.951103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789683729.951107:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789683729.951110:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e44000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683729.951115:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 628 00000100:00080000:2.0:1789683729.951121:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789683729.951132:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0e82e44000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683729.951174:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83db5f80 x1876618850309376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789683729.951236:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683729.951251:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850309504:0@lo:400:kworker.0 00000400:00000100:2.0:1789683729.951309:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850309504 offset 0 length 224: 4 00000100:00100000:0.0:1789683729.951426:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850309376:0@lo:38:kworker.0 00000400:00000100:3.0:1789683729.958734:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850309376 offset 0 length 520: 4 00010000:00010000:0.0:1789683730.018155:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1789683730.916538:0:3649:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683714/real 1789683714] req@ffff9f0e83db6680 x1876618850308480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683730 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683730.956144:0:3649:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f0e83db6680 x1876618850308480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683730 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789683730.956163:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e43000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789683730.956167:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789683730.974718:0:3649:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1789683730.974964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789683730.974972:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683730.974975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789683730.974978:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683730.974981:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789683730.975003:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789683730.975007:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e43000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683730.975015:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 567 00000100:00080000:1.0:1789683730.975042:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f0e82e43000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683730.975084:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c68e00 x1876618850309632/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683730.978176:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850308480:0@lo:400:kworker.0 00000100:00100000:2.0:1789683730.980066:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1876618850309632:0@lo:38:kworker.0 00000400:00000100:2.0:1789683730.980131:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850309632 offset 0 length 520: 4 00010000:00010000:0.0:1789683731.049620:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789683731.507214:0:21380:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789683731.525922:0:21380:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789683731.526007:0:21380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.526052:0:21380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.526060:0:21380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.526075:0:21380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.526096:0:21380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789683731.526102:0:21380:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789683731.526133:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789683731.526144:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0e83db5f80 x1876618850309376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789683749 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.526161:0:21380:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789683731.526166:0:21380:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789683731.526172:0:21380:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e44000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789683731.526176:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789683731.526179:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0e83db5f80 x1876618850309376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789683749 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.526186:0:21380:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789683731.526189:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:3.0:1789683731.526369:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683731.526377:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683731.526385:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683731.526389:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683731.526399:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683731.526406:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683731.526411:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789683731.526414:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789683731.526417:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789683731.526428:0:17189:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fb7aa0800 00010000:00010000:3.0:1789683731.526432:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683731.526438:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683731.526447:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683731.526449:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683731.526450:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683731.526495:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850309376:0@lo:38:kworker.0 00000100:00080000:0.0:1789683731.527987:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789683731.528002:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0e83db7800 x1876618850308736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683732 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.528036:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc1c68700 x1876618850308864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683735 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.528065:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc1c6aa00 x1876618850309120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683737 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.528095:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fa7de2300 x1876618850309248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683742 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.528107:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0e83db5500 x1876618850309504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683745 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.528122:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc1c68e00 x1876618850309632/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789683740 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.528132:0:21380:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789683731.528165:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850309504:0@lo:400:kworker.0 00000100:00080000:0.0:1789683731.528191:0:21380:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789683731.528197:0:21380:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e43000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789683731.528202:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789683731.528206:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0e83db7800 x1876618850308736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683732 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.528213:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc1c68700 x1876618850308864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683735 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.528220:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc1c6aa00 x1876618850309120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683737 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.528227:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fa7de2300 x1876618850309248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683742 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.528234:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc1c68e00 x1876618850309632/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789683740 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683731.528240:0:21380:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789683731.528243:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:3.0:1789683731.528389:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850308864:0@lo:400:kworker.0 00000100:00100000:3.0:1789683731.528416:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850308736:0@lo:400:kworker.0 00000100:00100000:3.0:1789683731.528443:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850309248:0@lo:400:kworker.0 00000100:00100000:3.0:1789683731.528467:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1876618850309632:0@lo:38:kworker.0 00000100:00100000:2.0:1789683731.528667:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850309120:0@lo:400:kworker.0 00010000:00010000:0.0:1789683731.530605:0:21380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.530622:0:21380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.530630:0:21380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.530637:0:21380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.530695:0:21380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683731.530704:0:21380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.530712:0:21380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.530718:0:21380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.530724:0:21380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683731.530806:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683731.530814:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683731.530822:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683731.530826:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683731.530834:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683731.530842:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683731.530847:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789683731.530850:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789683731.530861:0:17188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fb7aa0800 00010000:00010000:2.0:1789683731.530866:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683731.530886:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683731.530900:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683731.530903:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683731.530908:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683731.530912:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683731.530918:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683731.530924:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683731.530929:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789683731.530931:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789683731.530934:0:17188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fb7aa0800 00010000:00010000:2.0:1789683731.530937:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683731.530943:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683731.530944:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683731.530946:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683731.531234:0:21380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789683731.531239:0:21380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683731.531252:0:21380:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789683731.531265:0:21380:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789683731.531267:0:21380:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789683731.531299:0:21380:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789683731.531303:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789683731.531308:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683731.531313:0:21380:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789683731.531317:0:21380:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9f0fc04d99c0) has no exports 00000020:00080000:0.0:1789683731.531339:0:21380:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9f0fc04d99c0) has no exports 00010000:00010000:3.0:1789683731.538766:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789683731.540050:0:21380:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0fb60199c0 - data ffff9f0fafc480d8/ffff9f0fa7d7e800 00000020:01000000:0.0:1789683731.540212:0:21380:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0f92f5ca80 - data ffff9f0fafc3d510/ffff9f0e81da2400 00100000:10000000:0.0:1789683731.567808:0:21380:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789683731.585758:0:21380:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88aadb 00000020:00000080:0.0:1789683731.585774:0:21380:0:(genops.c:885:class_export_put()) final put ffff9f0f8a2c0000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789683731.585828:0:21380:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0f8721b000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789683731.585833:0:21380:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0f8721b000 2 00000020:01000004:0.0:1789683731.585837:0:21380:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0f8721b000 from lustre-OST0001 00000020:00000080:0.0:1789683731.585874:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683731.585887:0:21380:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789683731.585891:0:21380:0:(genops.c:885:class_export_put()) final put ffff9f0e82d51800/lustre-OST0001_UUID 00000020:00000080:0.0:1789683731.585894:0:21380:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d51800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789683731.585902:0:21380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789683731.586037:0:21380:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS 00010000:00010000:0.0:1789683731.586058:0:21380:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a826 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88a82d expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683731.586072:0:21380:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a826 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88a82d expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683731.586079:0:21380:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789683731.586083:0:21380:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789683731.586087:0:21380:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789683731.586107:0:21380:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fb7aa0800 00010000:00010000:0.0:1789683731.586123:0:21380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a826 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88a82d expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683731.586139:0:21380:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683731.586146:0:21380:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683731.586152:0:21380:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789683731.586154:0:21380:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789683731.586156:0:21380:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789683731.586179:0:21380:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fb7aa0800 00010000:00010000:0.0:1789683731.586183:0:21380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789683731.586203:0:21380:0:(import.c:65:import_set_state_nolock()) ffff9f0fb7aa0800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789683731.586208:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789683731.586211:0:21380:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789683731.586212:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789683731.586218:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789683731.586234:0:21380:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc1c6a300 x1876618850308992/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789683736 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789683731.586259:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789683731.586262:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:3.0:1789683731.586372:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8a2c0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1789683731.586921:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3646:1876618850308992:0@lo:250:kworker.0 10000000:01000000:0.0:1789683731.587334:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789683731.587356:0:21380:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88a700 00000020:00000080:0.0:1789683731.587365:0:21380:0:(genops.c:885:class_export_put()) final put ffff9f0e82753800/4e5e0833-60b8-4f67-ab09-c7aa3b4baab7 00000020:01000000:0.0:1789683731.587387:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.150@tcp (flags='') 00000020:00000080:0.0:1789683731.587395:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683731.587402:0:21380:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789683731.587416:0:21380:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9f0fb504b380) has no exports 00000020:00000080:3.0:1789683731.587435:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82753800/4e5e0833-60b8-4f67-ab09-c7aa3b4baab7 for MGC192.168.201.150@tcp 10000000:01000000:1.0:1789683731.591075:0:17197:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789683731.591534:0:21380:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.150@tcp: client import never connected 00000100:00080000:0.0:1789683731.591543:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789683731.591549:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789683731.591554:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789683731.591558:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789683731.591648:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683731.591661:0:21380:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.150@tcp (uuid 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7) 00000020:01000000:0.0:1789683731.591673:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789683731.591682:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683731.591689:0:21380:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789683731.591698:0:21380:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9f0e82e42800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789683731.591706:0:21380:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9f0e83c28000) has exports, disconnecting them 00000020:00080000:0.0:1789683731.591712:0:21380:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9f0e82e42800), last request at 1789683652 00000020:00000080:0.0:1789683731.591718:0:21380:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ab05 00000020:00080000:0.0:1789683731.591746:0:21380:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0e82e42800): rc 0 00000020:00000080:3.0:1789683731.591747:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fb7aa0800 for MGC192.168.201.150@tcp 00000020:00000080:0.0:1789683731.591758:0:21380:0:(genops.c:885:class_export_put()) final put ffff9f0e82e42800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789683731.591764:0:36:0:(genops.c:885:class_export_put()) final put ffff9f0fb7aa6000/4e5e0833-60b8-4f67-ab09-c7aa3b4baab7 00000020:00000080:3.0:1789683731.591770:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb7aa6000/4e5e0833-60b8-4f67-ab09-c7aa3b4baab7 for MGC192.168.201.150@tcp 00000020:01000000:3.0:1789683731.591777:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.150@tcp (4e5e0833-60b8-4f67-ab09-c7aa3b4baab7) 00000020:00000080:3.0:1789683731.592417:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82e42800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789683731.594728:0:21380:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789683731.594743:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789683731.594749:0:21380:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789683731.594759:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789683731.594838:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82e44000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789683731.598873:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683731.598892:0:21380:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789683731.598900:0:21380:0:(genops.c:885:class_export_put()) final put ffff9f0e82d99800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789683731.598907:0:21380:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d99800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789683731.598918:0:21380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789683731.600944:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789683731.602255:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683731.602275:0:21380:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789683731.602288:0:21380:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9f0f86d8b000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789683731.602320:0:21380:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9f0f861819c0) has exports, disconnecting them 00000020:00080000:0.0:1789683731.602327:0:21380:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9f0f86d8b000), last request at 1789683652 00000020:00000080:0.0:1789683731.602342:0:21380:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ab1a 00000020:00080000:0.0:1789683731.602371:0:21380:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0f86d8b000): rc 0 00000020:00000080:0.0:1789683731.602376:0:21380:0:(genops.c:885:class_export_put()) final put ffff9f0f86d8b000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789683731.602492:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f86d8b000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1789683731.614926:0:21380:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789683731.614936:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789683731.614941:0:21380:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789683731.614948:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789683731.614987:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82e43000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789683731.685551:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789683731.685627:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1789683731.685860:0:17184:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9f0f848ef200:17184] 1 exiting: rc = 0 00000100:00100000:0.0:1789683731.690668:0:17183:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9f0f848eee00:17183] 0 exiting: rc = 1 00000100:00100000:3.0:1789683731.691361:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.691749:0:20976:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9f0e826a6c00:20976] 3 exiting: rc = 0 00000100:00100000:0.0:1789683731.703532:0:17185:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9f0f848ef800:17185] 0 exiting: rc = 1 00000100:00100000:0.0:1789683731.703680:0:17186:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9f0f848ee800:17186] 1 exiting: rc = 0 00000100:00100000:0.0:1789683731.703760:0:17187:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9f0f848ef400:17187] 2 exiting: rc = 0 00000100:00100000:3.0:1789683731.703999:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704020:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704027:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704034:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704057:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704064:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704072:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704078:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704084:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704091:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704096:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704103:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704109:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704115:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704121:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704128:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704133:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704139:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704145:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704152:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704159:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704164:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704170:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704177:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704183:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704190:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704196:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704202:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704208:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704214:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704220:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704227:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704234:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704239:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704245:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704251:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704257:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704264:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704270:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704285:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704292:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704298:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704304:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704310:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704316:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704322:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704328:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704334:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704340:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704346:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704352:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704358:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704364:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704369:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704375:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704382:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704388:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704394:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704398:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704404:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704409:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704415:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704420:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.704437:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789683731.715088:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683731.715107:0:21380:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789683731.715115:0:21380:0:(genops.c:885:class_export_put()) final put ffff9f0e82e40000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789683731.715122:0:21380:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82e40000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789683731.715135:0:21380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789683731.715399:0:21380:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0f8721b000 1 00000020:00000080:3.0:1789683731.715408:0:21380:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88aabf 00000020:00000080:3.0:1789683731.715417:0:21380:0:(genops.c:885:class_export_put()) final put ffff9f0e82d50000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789683731.715437:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789683731.715463:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d50000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789683731.715478:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683731.715486:0:21380:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789683731.715491:0:21380:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9f0fa719b380) has no exports 00000020:00000080:1.0:1789683731.772233:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683731.772248:0:21380:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789683731.772254:0:21380:0:(genops.c:885:class_export_put()) final put ffff9f0f8721a800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789683731.772259:0:21380:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8721a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789683731.772274:0:21380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789683731.773020:0:21380:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0f87218000 00000020:01000000:1.0:1789683731.773046:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789683731.773051:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683731.773055:0:21380:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789683731.773061:0:21380:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9f0fa71999c0) has no exports 00000020:00000080:1.0:1789683731.773106:0:21380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683731.773112:0:21380:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789683731.773115:0:21380:0:(genops.c:885:class_export_put()) final put ffff9f0f86d6a800/OSS_uuid 00000020:00000080:1.0:1789683731.773118:0:21380:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f86d6a800/OSS_uuid for OSS 00000020:01000000:1.0:1789683731.773121:0:21380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789683731.773219:0:18710:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9f0f86c40000:18710] 2 exiting: rc = 0 00000100:00100000:0.0:1789683731.773363:0:18709:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9f0f86c40600:18709] 1 exiting: rc = 0 00000100:00100000:0.0:1789683731.773502:0:19141:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9f0e81cd5a00:19141] 3 exiting: rc = 0 00000100:00100000:2.0:1789683731.773695:0:18708:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9f0f8abef800:18708] 0 exiting: rc = 1 00000100:00080000:3.0:1789683731.773781:0:17196:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789683731.774137:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774152:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774159:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774163:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774169:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774185:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774210:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774227:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774235:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774246:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774255:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774268:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774282:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774291:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774307:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774313:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774318:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774323:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774331:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774338:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774343:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774348:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774352:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774356:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774362:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774367:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774374:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774379:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774384:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774390:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774398:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774403:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774409:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774414:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774420:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774425:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774430:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774435:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774440:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774445:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774714:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774735:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774898:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774911:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774917:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774922:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774928:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774934:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774940:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774945:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774950:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774962:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774969:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774974:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774979:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774984:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.774996:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.775017:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.775024:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.775030:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.775035:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.775042:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.775047:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.775053:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683731.779456:0:18712:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9f0f8ab5cc00:18712] 1 exiting: rc = 0 00000100:00100000:0.0:1789683731.779579:0:20774:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9f0f8abe3c00:20774] 2 exiting: rc = 0 00000100:00100000:3.0:1789683731.779660:0:18711:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9f0f8ab5c000:18711] 0 exiting: rc = 1 00000100:00100000:1.0:1789683731.779747:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779757:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779762:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779768:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779773:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779823:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779830:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779837:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779847:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779862:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779892:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779899:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779927:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779933:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779947:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779958:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779964:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779972:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779978:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779983:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779988:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779993:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.779998:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780003:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780019:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780024:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780029:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780038:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780044:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780049:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780054:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780060:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780066:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780072:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780078:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780083:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780092:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780097:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780104:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780109:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780114:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780118:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780124:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780129:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780136:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780141:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780147:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780160:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780166:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780172:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780178:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780184:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780191:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780198:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780203:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780208:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780213:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780218:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780224:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780229:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780235:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780240:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780246:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683731.780252:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.786550:0:18714:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9f0f8aace000:18714] 1 exiting: rc = 0 00000100:00100000:0.0:1789683731.787065:0:18713:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9f0f8aacf600:18713] 0 exiting: rc = 1 00000100:00100000:0.0:1789683731.787412:0:18715:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9f0f8aace400:18715] 2 exiting: rc = 0 00000100:00100000:3.0:1789683731.787682:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787703:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787710:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787715:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787721:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787726:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787731:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787737:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787743:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787748:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787753:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787759:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787765:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787770:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787776:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787815:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787822:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787829:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787834:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787840:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787846:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787851:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787856:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787860:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787866:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787887:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787894:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787900:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787917:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787923:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787929:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787934:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787940:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787946:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787952:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787957:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787962:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787968:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787973:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787978:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787985:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787991:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.787997:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788003:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788020:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788025:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788031:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788037:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788043:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788061:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788068:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788073:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788079:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788084:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788089:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788094:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788100:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788105:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788110:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788115:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788121:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788127:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788133:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.788145:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.798767:0:18716:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9f0fa53d1c00:18716] 0 exiting: rc = 1 00000100:00100000:3.0:1789683731.798893:0:18717:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9f0fa53d0000:18717] 1 exiting: rc = 0 00000100:00100000:3.0:1789683731.798946:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.798954:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.798959:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.798965:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.798970:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.798975:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.798981:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.798986:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.798991:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.798997:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799001:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799026:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799032:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799037:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799042:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799047:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799053:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799059:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799064:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799069:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799075:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799080:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799086:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799091:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799096:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799100:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799105:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799110:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799115:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799120:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799126:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799132:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799156:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799161:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799166:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799171:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799177:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799182:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799187:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799192:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799197:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799202:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799207:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799212:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799217:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799223:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799229:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799234:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799239:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799244:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799249:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799255:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799261:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799266:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799271:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799276:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799282:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799287:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799292:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799298:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799304:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799309:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799314:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683731.799320:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809016:0:18718:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9f0f86c42200:18718] 0 exiting: rc = 1 00000100:00100000:2.0:1789683731.809120:0:18719:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9f0fa53d0600:18719] 1 exiting: rc = 0 00000100:00100000:2.0:1789683731.809184:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809226:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809232:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809238:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809243:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809249:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809257:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809262:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809268:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809273:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809278:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809284:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809289:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809305:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809310:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809316:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809323:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809329:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809335:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809341:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809347:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809353:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809358:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809363:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809371:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809386:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809393:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809398:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809404:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809410:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809414:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809420:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809436:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809441:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809446:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809451:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809456:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809473:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809479:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809484:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809489:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809495:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809500:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809505:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809510:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809516:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809521:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809526:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809531:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809546:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809553:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809558:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809563:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809569:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809575:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809580:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809586:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809591:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809597:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809602:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809607:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809612:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809617:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683731.809627:0:21380:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789683731.824513:0:21380:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789683756.883079:0:22144:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789683769.399742:0:22745:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789683769.399749:0:22745:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789683769.399756:0:22745:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789683769.400016:0:22745:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0fc06b2000 00000020:01000004:3.0:1789683769.400032:0:22745:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789683769.400041:0:22745:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789683769.400054:0:22745:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f0fc04db380) 00000020:00000080:3.0:1789683769.400069:0:22745:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789683769.454595:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789683769.455536:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.456198:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789683769.456450:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789683769.456819:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789683769.457068:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789683769.457299:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789683769.457604:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789683769.457863:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789683769.458045:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789683769.458434:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789683769.459361:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789683769.459856:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789683769.460532:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789683769.463238:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789683769.464577:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.464808:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.465030:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.465264:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.465555:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.465924:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.466778:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.467121:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.467429:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.467710:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.467958:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.468306:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.468534:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.468746:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.469308:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.469741:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.470601:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.471351:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.473511:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.474392:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.474698:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.474987:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.475498:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.476609:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.477087:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789683769.477368:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789683769.477581:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789683769.478499:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789683769.478809:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789683769.479039:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789683769.479302:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789683769.479988:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789683769.481390:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789683769.481884:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789683769.482369:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789683769.482765:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789683769.483604:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789683769.485961:0:22745:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1789683769.487291:0:22745:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789683769.487529:0:22745:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789683769.487539:0:22745:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789683769.487551:0:22745:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88b006 00000020:01000004:2.0:1789683769.487559:0:22745:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789683769.487564:0:22745:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789683769.487569:0:22745:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0fc06b2000 from MGS 00000020:01000004:2.0:1789683769.487573:0:22745:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789683769.487583:0:22745:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f0fc1243380) 00000020:00000080:2.0:1789683769.487594:0:22745:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789683769.487658:0:22745:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fc06b2000 from MGS, refs=2 00080000:01000000:2.0:1789683769.487664:0:22745:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789683769.487668:0:22745:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88b014 00000100:00100000:2.0:1789683769.487768:0:22745:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789683769.487963:0:22745:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789683769.487970:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789683769.490425:0:22745:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789683769.490437:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789683769.491088:0:22745:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683769.491292:0:22745:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789683769.491297:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789683769.493839:0:22745:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789683769.493857:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789683769.495288:0:22745:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789683769.495300:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789683769.496140:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683769.496144:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683769.496146:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683769.497860:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683769.497864:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683769.497866:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683769.498511:0:22745:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789683769.499876:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789683769.508241:0:22745:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789683769.510319:0:22757:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789683769.510399:0:22745:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789683769.510446:0:22745:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789683769.514996:0:22745:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789683769.515389:0:22745:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683769.515547:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789683769.515554:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789683769.515906:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789683769.515912:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789683769.518556:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789683769.518571:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789683769.521598:0:22745:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789683769.521623:0:22745:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.150@tcp' 00000020:01000004:1.0:1789683769.521625:0:22745:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789683769.521657:0:22745:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.150@tcp (typ=mgc) 00000020:00000080:1.0:1789683769.521671:0:22745:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.150@tcp (ffff9f0f86180000) 00000020:00000080:1.0:1789683769.521688:0:22745:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789683769.521776:0:22745:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fa7da2800@MGC192.168.201.150@tcp: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789683769.522115:0:22745:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.150@tcp-0 is initialized 00000040:01000000:1.0:1789683769.522122:0:22745:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789683769.522721:0:22762:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789683769.523037:0:22763:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789683769.525861:0:22745:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.150@tcp (uuid acf86134-5469-4898-92a9-e106d5944cd1) 00000020:00000080:1.0:1789683769.525897:0:22745:0:(genops.c:1384:class_connect()) connect: client acf86134-5469-4898-92a9-e106d5944cd1, cookie 0xcf8485587b88b022 00000100:00080000:1.0:1789683769.525910:0:22745:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683769.525922:0:22745:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import ffff9f0fa7da2800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683769.525963:0:22745:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c6b100 x1876618850309760/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683769.526017:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:acf86134-5469-4898-92a9-e106d5944cd1:3646:1876618850309760:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789683769.526087:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789683769.526148:0:22745:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import acf86134-5469-4898-92a9-e106d5944cd1->MGS 00000020:01000004:1.0:1789683769.526173:0:22745:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789683769.526179:0:22745:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789683769.526195:0:22745:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9f0f86183380) 00000020:00000080:1.0:1789683769.526435:0:22745:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789683769.531079:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850309760 00000100:00100000:3.0:1789683769.531095:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850309760 00000100:00100000:3.0:1789683769.531153:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789683769.531162:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3646:x1876618850309760:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789683769.531367:0:22760:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from acf86134-5469-4898-92a9-e106d5944cd1@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:3.0:1789683769.531411:0:22760:0:(genops.c:1384:class_connect()) connect: client acf86134-5469-4898-92a9-e106d5944cd1, cookie 0xcf8485587b88b030 00000100:00080000:3.0:1789683769.531580:0:22760:0:(import.c:65:import_set_state_nolock()) ffff9f0fc06b0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683769.531691:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+5:3646:x1876618850309760:12345-0@lo:250:mount.lustre.0 Request processed in 527us (5601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683769.531700:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683769.531763:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789683769.531773:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.150@tcp: connect to target with instance 0 00000100:00080000:1.0:1789683769.531780:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789683769.531917:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789683769.531921:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fa7da2800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789683769.531924:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789683769.531933:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789683769.531939:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:acf86134-5469-4898-92a9-e106d5944cd1:3646:1876618850309760:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789683769.539972:0:22745:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683769.540155:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789683769.540161:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789683769.543406:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789683769.543420:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789683769.563432:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789683769.563504:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789683769.564427:0:22745:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683769.564768:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789683769.564775:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789683769.576398:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789683769.576413:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789683769.659556:0:22745:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789683769.659841:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789683769.659848:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789683769.673298:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789683769.673327:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789683769.674536:0:22745:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683769.674720:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789683769.674725:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789683769.683569:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789683769.683589:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789683769.687209:0:22745:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683769.687437:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789683769.687446:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789683769.689766:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789683769.689779:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789683769.695547:0:22745:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683769.695745:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789683769.695754:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789683769.701552:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789683769.701572:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789683769.757521:0:22745:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683769.757755:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789683769.757762:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789683769.759777:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789683769.759833:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789683769.763484:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789683769.766066:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789683769.774869:0:22745:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789683769.774916:0:22745:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789683769.774924:0:22745:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789683769.775058:0:22745:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789683769.775101:0:22745:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.150@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789683769.775105:0:22745:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789683769.775107:0:22745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683769.775108:0:22745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683769.775109:0:22745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683769.775110:0:22745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683769.775111:0:22745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683769.775113:0:22745:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683769.775114:0:22745:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683769.775116:0:22745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683769.775117:0:22745:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683769.775121:0:22745:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789683769.775123:0:22745:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683769.775124:0:22745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683769.775125:0:22745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683769.775126:0:22745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683769.775127:0:22745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683769.775128:0:22745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683769.775129:0:22745:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683769.775130:0:22745:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683769.775130:0:22745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683769.775131:0:22745:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683769.775175:0:22745:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789683769.775199:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850309888:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789683769.775272:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683769.775314:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683769.775774:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850309888 00000100:00100000:1.0:1789683769.775811:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850309888 00000100:00100000:1.0:1789683769.775868:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683769.775878:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+5:22745:x1876618850309888:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789683769.775931:0:22761:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789683769.775935:0:22761:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789683769.775938:0:22761:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789683769.776616:0:22782:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789683769.777195:0:22761:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1789683769.783738:0:22783:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789683769.783747:0:22783:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789683769.783750:0:22783:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789683769.783752:0:22783:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789683769.784145:0:22783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1789683769.784370:0:22761:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789683769.784381:0:22761:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789683769.787354:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+5:22745:x1876618850309888:12345-0@lo:253:mount.lustre.0 Request processed in 11468us (12072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683769.787371:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683769.787515:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850309888:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789683769.787531:0:22745:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789683769.787547:0:22745:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683769.787549:0:22745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683769.787551:0:22745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683769.787552:0:22745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683769.787553:0:22745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683769.787555:0:22745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683769.787556:0:22745:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683769.787558:0:22745:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683769.787561:0:22745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683769.787562:0:22745:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789683769.787582:0:22745:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0fc06b2000 from lustre-MDT0000 10000000:01000000:0.0:1789683769.787612:0:22745:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789683769.787615:0:22745:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789683769.787619:0:22745:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f0f86180000 10000000:01000000:0.0:1789683769.787623:0:22745:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789683769.787631:0:22745:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0f86180000 from 1 10000000:01000000:0.0:1789683769.787634:0:22745:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789683769.787672:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683769.787683:0:22745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683769.787692:0:22745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683769.787711:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789683769.787748:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683769.787831:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683769.787968:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850310016 00000100:00100000:3.0:1789683769.787975:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850310016 00000100:00100000:3.0:1789683769.788026:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683769.788034:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+5:22745:x1876618850310016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683769.788048:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683769.788062:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb1bc3c00/0xcf8485587b88b03e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b037 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683769.788085:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb1bc3c00/0xcf8485587b88b03e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b037 expref: 6 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683769.788095:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb1bc3c00/0xcf8485587b88b03e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b037 expref: 6 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683769.788103:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc3c00, rc 0) 00000100:00100000:3.0:1789683769.788157:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+6:22745:x1876618850310016:12345-0@lo:101:mount.lustre.0 Request processed in 123us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683769.788164:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683769.788422:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683769.788436:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683769.788445:0:22745:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683769.788523:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683769.788553:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683769.788571:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922300 going to sleep for 11 seconds 00000100:00100000:1.0:1789683769.788676:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850310144 00000100:00100000:1.0:1789683769.788681:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850310144 00000100:00100000:1.0:1789683769.788717:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683769.788730:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+6:22745:x1876618850310144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683769.788846:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+6:22745:x1876618850310144:12345-0@lo:501:mount.lustre.0 Request processed in 117us (292us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683769.788853:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683769.789019:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310144:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789683769.789047:0:22745:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789683769.789065:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683769.789074:0:22745:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683769.789081:0:22745:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0fc06b2000 10000000:01000000:2.0:1789683769.789086:0:22745:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789683769.789090:0:22745:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0fc06b2000 10000000:01000000:2.0:1789683769.789099:0:22745:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789683769.789102:0:22745:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0fc06b2000 from 1 10000000:01000000:2.0:1789683769.789104:0:22745:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789683769.789124:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30a00/0xcf8485587b88b045 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683769.789131:0:22745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30a00/0xcf8485587b88b045 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683769.789138:0:22745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30a00/0xcf8485587b88b045 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683769.789150:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683769.789176:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683769.789203:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683769.789305:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850310272 00000100:00100000:0.0:1789683769.789310:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850310272 00000100:00100000:0.0:1789683769.789359:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683769.789366:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+6:22745:x1876618850310272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683769.789393:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683769.789406:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88b04c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b045 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683769.789423:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88b04c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b045 expref: 7 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683769.789431:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88b04c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b045 expref: 7 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683769.789439:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d400, rc 0) 00000100:00100000:0.0:1789683769.789471:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+7:22745:x1876618850310272:12345-0@lo:101:mount.lustre.0 Request processed in 106us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683769.789477:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683769.789723:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683769.789739:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30a00/0xcf8485587b88b045 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b04c expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683769.789746:0:22745:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30a00/0xcf8485587b88b045 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b04c expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683769.789758:0:22745:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789683769.789773:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30a00/0xcf8485587b88b045 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b04c expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683769.789779:0:22745:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30a00/0xcf8485587b88b045 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b04c expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683769.789966:0:22745:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789683769.789976:0:22745:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683769.789981:0:22745:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0fc06b2000 10000000:01000000:2.0:1789683769.789983:0:22745:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789683769.790055:0:22745:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789683769.790059:0:22745:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789683769.790079:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b88b053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683769.790086:0:22745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b88b053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683769.790093:0:22745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b88b053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683769.790107:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683769.790137:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683769.790256:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683769.796839:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850310400 00000100:00100000:0.0:1789683769.796856:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850310400 00000100:00100000:0.0:1789683769.796919:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683769.796929:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+7:22745:x1876618850310400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683769.796947:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683769.796969:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454c400/0xcf8485587b88b05a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b053 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683769.797010:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454c400/0xcf8485587b88b05a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b053 expref: 8 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683769.797021:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454c400/0xcf8485587b88b05a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b053 expref: 8 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683769.797030:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c400, rc 0) 00000100:00100000:0.0:1789683769.797125:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+8:22745:x1876618850310400:12345-0@lo:101:mount.lustre.0 Request processed in 198us (6987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683769.797131:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683769.797666:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683769.797688:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b88b053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b05a expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683769.797699:0:22745:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b88b053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b05a expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683769.797820:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683769.797865:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683769.797903:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683769.797971:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850310528 00000100:00100000:2.0:1789683769.797977:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850310528 00000100:00100000:2.0:1789683769.798024:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683769.798031:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+8:22745:x1876618850310528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683769.798186:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+9:22745:x1876618850310528:12345-0@lo:501:mount.lustre.0 Request processed in 155us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683769.798194:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683769.798591:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683769.798628:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683769.798679:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683769.798703:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789683769.798846:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850310656 00000100:00100000:3.0:1789683769.798851:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850310656 00000100:00100000:3.0:1789683769.798886:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683769.798893:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+9:22745:x1876618850310656:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683769.800343:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+9:22745:x1876618850310656:12345-0@lo:503:mount.lustre.0 Request processed in 1435us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683769.800354:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683769.800632:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850310656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683769.807502:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22784:1876618850310784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683769.807610:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683769.807709:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683769.812584:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850310784 00000100:00100000:1.0:1789683769.812605:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850310784 00000100:00100000:1.0:1789683769.812672:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683769.812685:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+9:22784:x1876618850310784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683769.815281:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+9:22784:x1876618850310784:12345-0@lo:502:llog_process_th.0 Request processed in 2589us (7661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683769.815295:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789683769.815555:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22784:1876618850310784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789683769.815600:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683769.815611:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683769.815614:0:22784:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789683769.815618:0:22784:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789683769.815621:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789683769.815637:0:22784:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f0fc1240000) 00000020:00000080:2.0:1789683769.815655:0:22784:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789683769.815661:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789683769.815761:0:22784:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789683769.815768:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88b068 00000020:00000080:2.0:1789683769.816158:0:22784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789683769.816164:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683769.816169:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683769.816170:0:22784:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789683769.816173:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683769.816177:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683769.816178:0:22784:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789683769.816181:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789683769.816188:0:22784:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f0fc1244d40) 00000020:00000080:2.0:1789683769.816198:0:22784:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789683769.816201:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789683769.816203:0:22784:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789683769.816206:0:22784:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789683769.816211:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789683769.816257:0:22784:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fc06b2000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789683769.816269:0:22784:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f0fc12419c0) 00000020:00000080:2.0:1789683769.816277:0:22784:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789683769.816343:0:22784:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789683769.816348:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88b07d 00000020:00000080:2.0:1789683769.816626:0:22784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789683769.816632:0:22784:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789683769.816646:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcf8485587b88b084 00080000:01000000:2.0:1789683769.816652:0:22784:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789683769.816656:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88b08b 00010000:00010000:1.0:1789683769.936172:0:22784:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789683769.936894:0:22784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:1.0:1789683769.937209:0:22784:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789683769.938309:0:22784:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f0f86184d40) 00000020:00000080:1.0:1789683769.938344:0:22784:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789683769.938539:0:22784:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789683769.938547:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88b099 00000020:00000080:2.0:1789683769.940015:0:22784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789683769.959871:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcf8485587b88b0a0 00000020:00000080:3.0:1789683769.960268:0:22784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789683769.960281:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683769.960288:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683769.960291:0:22784:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789683769.960294:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789683769.960297:0:22784:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789683769.960299:0:22784:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789683769.960300:0:22784:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789683769.960302:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789683769.960304:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683769.960305:0:22784:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789683769.960308:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683769.960313:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683769.960315:0:22784:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789683769.960320:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789683769.960371:0:22784:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789683769.960388:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683769.960392:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683769.960394:0:22784:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789683769.960396:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683769.960399:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683769.960400:0:22784:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789683769.960403:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789683769.960408:0:22784:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:00000080:3.0:1789683769.960446:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683769.960470:0:22784:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9f0fc04dcd40) 00000020:00000080:3.0:1789683769.960485:0:22784:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789683769.960491:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789683769.960548:0:22784:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789683769.960553:0:22784:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789683769.960560:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88b0ae 00010000:00080000:3.0:1789683769.960594:0:22784:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fc148e800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789683769.962291:0:22784:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789683769.968319:0:22784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789683769.968346:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789683769.968405:0:22784:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789683769.968428:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88b0b5 00000100:00080000:3.0:1789683769.968439:0:22784:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683769.968451:0:22784:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0fc148e800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683769.968491:0:22784:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7e31180 x1876618850310912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683769.968523:0:22784:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1789683769.968589:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683769.968592:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683769.968594:0:22784:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789683769.968597:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789683769.968600:0:22784:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1789683769.968601:0:22784:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789683769.968603:0:22784:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789683769.968604:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789683769.968606:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683769.968608:0:22784:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789683769.968610:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789683769.968615:0:22784:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789683769.968619:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683769.968620:0:22784:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789683769.968640:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789683769.968645:0:22784:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:3.0:1789683769.968668:0:22784:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789683769.968671:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683769.968685:0:22784:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f0fc04d99c0) 00000020:00000080:3.0:1789683769.968698:0:22784:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789683769.968704:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789683769.968938:0:22784:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789683769.968944:0:22784:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789683769.968951:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88b0c3 00010000:00080000:3.0:1789683769.968980:0:22784:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fc0500000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789683769.969174:0:22784:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1789683769.969548:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850310912:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789683769.969628:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683769.969744:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850310912 00000100:00100000:2.0:1789683769.969753:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850310912 00000100:00100000:2.0:1789683769.969818:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683769.969826:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1876618850310912:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789683769.969843:0:22771:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789683769.973809:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850311040:0@lo:400:kworker.0 00000100:00100000:1.0:1789683769.973887:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683769.974032:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850311040 00000100:00100000:0.0:1789683769.974040:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850311040 00000100:00100000:0.0:1789683769.974088:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683769.974098:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+9:3648:x1876618850311040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683769.974160:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+9:3648:x1876618850311040:12345-0@lo:400:kworker.0 Request processed in 63us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683769.974166:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683769.974214:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850311040:0@lo:400:kworker.0 00000040:01000000:3.0:1789683769.979025:0:22784:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789683769.979281:0:22784:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789683769.982602:0:22784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683769.983558:0:22784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:2.0:1789683769.996727:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1876618850310912:12345-0@lo:38:llog_process_th.0 Request processed in 26893us (27092us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789683769.996742:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789683769.997412:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789683769.997419:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789683769.997424:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850310912:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789683769.998140:0:22784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1789683769.999027:0:22790:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789683769.999033:0:22790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789683770.001306:0:22784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683770.001334:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789683770.001380:0:22784:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789683770.001415:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88b0ca 00000100:00080000:1.0:1789683770.001425:0:22784:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683770.001436:0:22784:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0fc0500000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683770.001471:0:22784:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c69500 x1876618850311168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683770.001523:0:22784:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789683770.001587:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683770.001592:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683770.001594:0:22784:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789683770.001597:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789683770.001600:0:22784:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1789683770.001602:0:22784:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683770.001604:0:22784:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683770.001605:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789683770.001607:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683770.001609:0:22784:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789683770.001611:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789683770.001616:0:22784:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789683770.001619:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683770.001620:0:22784:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789683770.001623:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789683770.001627:0:22784:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:1.0:1789683770.001650:0:22784:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789683770.001653:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683770.001669:0:22784:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f0f861819c0) 00000020:00000080:1.0:1789683770.001682:0:22784:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789683770.001687:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789683770.001748:0:22784:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789683770.001755:0:22784:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789683770.001760:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88b0d8 00010000:00080000:1.0:1789683770.001829:0:22784:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e83c34000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789683770.002050:0:22784:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789683770.002130:0:22784:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789683770.002145:0:22784:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1789683770.003332:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850311168:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789683770.003407:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850311168 offset 0 length 520: 4 00000040:00080000:0.0:1789683770.005320:0:22784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683770.006073:0:22784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789683770.006244:0:22784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1789683770.006706:0:22792:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789683770.006711:0:22792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789683770.007571:0:22784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789683770.007583:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789683770.007624:0:22784:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789683770.007649:0:22784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88b0df 00000100:00080000:0.0:1789683770.007662:0:22784:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789683770.007675:0:22784:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0e83c34000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683770.007714:0:22784:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7de0a80 x1876618850311296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789683770.007746:0:22784:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789683770.007900:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850311296:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789683770.007957:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850311296 offset 0 length 520: 4 00000020:01000000:0.0:1789683770.008203:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683770.008208:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683770.008220:0:22784:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789683770.008224:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683770.008228:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683770.008230:0:22784:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789683770.008233:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789683770.008235:0:22784:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789683770.008237:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683770.008239:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683770.008240:0:22784:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789683770.008243:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683770.008245:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683770.008246:0:22784:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789683770.008250:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789683770.008282:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22784:1876618850311424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683770.008344:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683770.008369:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f836106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683770.008473:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850311424 00000100:00100000:1.0:1789683770.008481:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850311424 00000100:00100000:1.0:1789683770.008540:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683770.008549:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+9:22784:x1876618850311424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683770.008692:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+9:22784:x1876618850311424:12345-0@lo:502:llog_process_th.0 Request processed in 143us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683770.008701:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683770.008847:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22784:1876618850311424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789683770.008875:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683770.008880:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683770.008881:0:22784:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789683770.008886:0:22784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789683770.009108:0:22745:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789683770.009131:0:22745:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789683770.009152:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b88b053 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b05a expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683770.009165:0:22745:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b88b053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b05a expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683770.009173:0:22745:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fc06b2000 from 1 10000000:01000000:1.0:1789683770.009175:0:22745:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789683770.009203:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683770.009212:0:22745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683770.009222:0:22745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683770.009238:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850311552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683770.009269:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683770.009292:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683770.009310:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850311552 00000100:00100000:1.0:1789683770.009314:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850311552 00000100:00100000:1.0:1789683770.009357:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789683770.009364:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+9:22745:x1876618850311552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683770.009373:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683770.009398:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b0ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b0e6 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683770.009421:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b0e6 expref: 10 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683770.009432:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b0e6 expref: 10 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683770.009440:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8e00, rc 0) 00000100:00100000:1.0:1789683770.009470:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+10:22745:x1876618850311552:12345-0@lo:101:mount.lustre.0 Request processed in 106us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683770.009476:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789683770.009510:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850311552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683770.009523:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683770.009532:0:22745:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683770.010212:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850311680:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789683770.010253:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683770.010270:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683770.010289:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850311680 00000100:00100000:1.0:1789683770.010293:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850311680 00000100:00100000:1.0:1789683770.010373:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683770.010380:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+10:22745:x1876618850311680:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789683770.010777:0:22760:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789683770.010875:0:22760:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789683770.010946:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+10:22745:x1876618850311680:12345-0@lo:256:mount.lustre.0 Request processed in 566us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683770.010954:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789683770.011055:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850311680:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789683770.011757:0:22745:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789683770.012141:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.012171:0:22745:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683770.012180:0:22745:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fc06b2000 from 1 10000000:01000000:2.0:1789683770.012184:0:22745:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683770.012219:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.012227:0:22745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.012238:0:22745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683770.012258:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850311808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683770.012307:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683770.012354:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789683770.012435:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850311808 00000100:00100000:0.0:1789683770.012443:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850311808 00000100:00100000:0.0:1789683770.012497:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683770.012506:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+10:22745:x1876618850311808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683770.012519:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683770.012532:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454c200/0xcf8485587b88b0fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b0f4 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683770.012554:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454c200/0xcf8485587b88b0fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b0f4 expref: 11 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683770.012566:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454c200/0xcf8485587b88b0fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b0f4 expref: 11 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683770.012574:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c200, rc 0) 00000100:00100000:0.0:1789683770.012629:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+11:22745:x1876618850311808:12345-0@lo:101:mount.lustre.0 Request processed in 123us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683770.012634:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683770.012828:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850311808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683770.012843:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683770.012851:0:22745:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683770.012930:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850311936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683770.012958:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683770.012983:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85555c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683770.013616:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850311936 00000100:00100000:2.0:1789683770.013624:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850311936 00000100:00100000:2.0:1789683770.013657:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683770.013664:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+11:22745:x1876618850311936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683770.013873:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+11:22745:x1876618850311936:12345-0@lo:501:mount.lustre.0 Request processed in 208us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683770.013880:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683770.014231:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850311936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683770.014273:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850312064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683770.014318:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683770.014357:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85555c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683770.014568:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850312064 00000100:00100000:2.0:1789683770.014575:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850312064 00000100:00100000:2.0:1789683770.014609:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683770.014616:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+11:22745:x1876618850312064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683770.014718:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+11:22745:x1876618850312064:12345-0@lo:503:mount.lustre.0 Request processed in 102us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683770.014724:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789683770.014820:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850312064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683770.015570:0:22794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22794:1876618850312192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683770.015616:0:22794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683770.015646:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85555840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683770.015703:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850312192 00000100:00100000:0.0:1789683770.015709:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850312192 00000100:00100000:0.0:1789683770.015742:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789683770.015750:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+11:22794:x1876618850312192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683770.016569:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+11:22794:x1876618850312192:12345-0@lo:502:llog_process_th.0 Request processed in 815us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683770.016577:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789683770.016724:0:22794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22794:1876618850312192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683770.016757:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683770.016766:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683770.016768:0:22794:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789683770.016775:0:22794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0fc06b2000 00000020:00000080:3.0:1789683770.016777:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683770.016907:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683770.016911:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683770.016913:0:22794:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789683770.016915:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683770.016918:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683770.016920:0:22794:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789683770.016923:0:22794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0fc06b2000 00000020:00000080:3.0:1789683770.016925:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683770.016997:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683770.017001:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683770.017003:0:22794:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789683770.017005:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683770.017008:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683770.017010:0:22794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789683770.017013:0:22794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0fc06b2000 00000020:00000080:3.0:1789683770.017022:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683770.017041:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683770.017044:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683770.017045:0:22794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789683770.017048:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683770.017050:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683770.017051:0:22794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789683770.017055:0:22794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0fc06b2000 00000020:00000080:3.0:1789683770.017057:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789683770.017094:0:22794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22794:1876618850312320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683770.017134:0:22794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683770.020453:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92462d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683770.030615:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850312320 00000100:00100000:1.0:1789683770.030636:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850312320 00000100:00100000:1.0:1789683770.030708:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683770.030718:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+11:22794:x1876618850312320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683770.031207:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+11:22794:x1876618850312320:12345-0@lo:502:llog_process_th.0 Request processed in 489us (14070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683770.031216:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683770.032021:0:22794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22794:1876618850312320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683770.032059:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683770.032068:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683770.032071:0:22794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789683770.032076:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789683770.032698:0:22745:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789683770.032720:0:22745:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683770.032734:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.032747:0:22745:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683770.034607:0:22745:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683770.034616:0:22745:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0fc06b2000 10000000:01000000:2.0:1789683770.034619:0:22745:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0fc06b2000 10000000:01000000:2.0:1789683770.034623:0:22745:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683770.034630:0:22745:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0fc06b2000 from 1 10000000:01000000:2.0:1789683770.034633:0:22745:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683770.034671:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31800/0xcf8485587b88b102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.034683:0:22745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31800/0xcf8485587b88b102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.034695:0:22745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31800/0xcf8485587b88b102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683770.034720:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850312448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683770.035960:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683770.036019:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683770.036058:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850312448 00000100:00100000:2.0:1789683770.036067:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850312448 00000100:00100000:2.0:1789683770.036121:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789683770.036131:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+11:22745:x1876618850312448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683770.036146:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683770.036165:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a30600/0xcf8485587b88b109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b102 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.036194:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a30600/0xcf8485587b88b109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b102 expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.036205:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb7a30600/0xcf8485587b88b109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b102 expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.036214:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30600, rc 0) 00000100:00100000:2.0:1789683770.036270:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+12:22745:x1876618850312448:12345-0@lo:101:mount.lustre.0 Request processed in 140us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683770.036277:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789683770.036342:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850312448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683770.036359:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31800/0xcf8485587b88b102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b109 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.036368:0:22745:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31800/0xcf8485587b88b102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b109 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683770.038718:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850312576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683770.039564:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683770.039655:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683770.047922:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850312576 00000100:00100000:0.0:1789683770.047942:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850312576 00000100:00100000:0.0:1789683770.048036:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789683770.048048:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+12:22745:x1876618850312576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683770.048254:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+12:22745:x1876618850312576:12345-0@lo:501:mount.lustre.0 Request processed in 207us (8693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683770.048262:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789683770.048332:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850312576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683770.048390:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850312704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683770.048442:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683770.048478:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683770.050501:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850312704 00000100:00100000:0.0:1789683770.050515:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850312704 00000100:00100000:0.0:1789683770.050574:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683770.050584:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+12:22745:x1876618850312704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683770.050729:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+12:22745:x1876618850312704:12345-0@lo:503:mount.lustre.0 Request processed in 147us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683770.050737:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789683770.051185:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850312704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683770.058205:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22799:1876618850312832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683770.058299:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683770.058354:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83610f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683770.058377:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850312832 00000100:00100000:0.0:1789683770.058395:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850312832 00000100:00100000:0.0:1789683770.058442:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683770.058452:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+12:22799:x1876618850312832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683770.058595:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+12:22799:x1876618850312832:12345-0@lo:502:llog_process_th.0 Request processed in 144us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683770.058604:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789683770.060704:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22799:1876618850312832:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789683770.060819:0:22799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789683770.060841:0:22799:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f0e83c28000) 00000020:00000080:2.0:1789683770.060862:0:22799:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789683770.060964:0:22799:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fc06b2000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789683770.060968:0:22799:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0fc06b2000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789683770.060971:0:22799:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fc06b2000 4 00010000:00080000:2.0:1789683770.060999:0:22799:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fc06a5800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789683770.062707:0:22799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789683770.067196:0:22799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789683770.067250:0:22799:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789683770.067268:0:22799:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcf8485587b88b117 00000100:00080000:3.0:1789683770.067278:0:22799:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683770.067293:0:22799:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f0fc06a5800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683770.067344:0:22799:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7e30000 x1876618850312960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683770.067379:0:22799:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789683770.074833:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850312960:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789683770.074922:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683770.075136:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850312960 00000100:00100000:1.0:1789683770.075146:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850312960 00000100:00100000:1.0:1789683770.075196:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683770.075204:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850312960:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789683770.075962:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850312960:12345-0@lo:38:llog_process_th.0 Request processed in 755us (1037us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789683770.075972:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683770.080331:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789683770.080345:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc06a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683770.080352:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789683770.080356:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850312960:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789683770.085570:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22799:1876618850313088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683770.085670:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683770.085719:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fa0051900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683770.085836:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850313088 00000100:00100000:2.0:1789683770.085846:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850313088 00000100:00100000:2.0:1789683770.085902:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789683770.085911:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+12:22799:x1876618850313088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683770.086045:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+12:22799:x1876618850313088:12345-0@lo:502:llog_process_th.0 Request processed in 135us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683770.086059:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789683770.088118:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22799:1876618850313088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683770.088193:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22799:1876618850313216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683770.088266:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683770.088309:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fa0051900 going to sleep for 11 seconds 00000100:00100000:0.0:1789683770.088373:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850313216 00000100:00100000:0.0:1789683770.088380:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850313216 00000100:00100000:0.0:1789683770.088438:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683770.088447:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+12:22799:x1876618850313216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683770.088567:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+12:22799:x1876618850313216:12345-0@lo:502:llog_process_th.0 Request processed in 121us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683770.088575:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789683770.089352:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:acf86134-5469-4898-92a9-e106d5944cd1:22799:1876618850313216:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789683770.089384:0:22799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789683770.090976:0:22745:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789683770.091014:0:22745:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789683770.091038:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31800/0xcf8485587b88b102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b109 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683770.091050:0:22745:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31800/0xcf8485587b88b102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b109 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789683770.091104:0:22745:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789683770.091106:0:22745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789683770.091107:0:22745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683770.091109:0:22745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683770.091110:0:22745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683770.091111:0:22745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683770.091113:0:22745:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683770.091115:0:22745:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789683770.091116:0:22745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683770.091117:0:22745:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789683770.091121:0:22745:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789683770.091124:0:22745:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789683770.091125:0:22745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789683770.091127:0:22745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683770.091128:0:22745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683770.091129:0:22745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683770.091130:0:22745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683770.091131:0:22745:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683770.091132:0:22745:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789683770.091133:0:22745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683770.091134:0:22745:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789683770.091155:0:22745:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789683770.091173:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850313344:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789683770.091235:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683770.091274:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fa00513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683770.091539:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850313344 00000100:00100000:2.0:1789683770.091547:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850313344 00000100:00100000:2.0:1789683770.091599:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683770.091607:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+12:22745:x1876618850313344:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789683770.091633:0:22760:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789683770.091648:0:22760:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789683770.097901:0:22760:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789683770.097921:0:22760:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789683770.099593:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+12:22745:x1876618850313344:12345-0@lo:253:mount.lustre.0 Request processed in 7978us (8349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683770.099609:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:1.0:1789683770.100391:0:22782:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789683770.100414:0:22782:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789683770.100435:0:22782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683770.100451:0:22782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b0ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b0e6 expref: 11 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683770.100459:0:22782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683770.100500:0:22782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b0e6 expref: 11 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683770.100517:0:22782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b0ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b0e6 expref: 11 pid: 22760 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683770.100531:0:22782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850313472:0@lo:104: 00000100:00100000:1.0:1789683770.100584:0:22782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683770.100635:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e837206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683770.100901:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850313472 00000100:00100000:2.0:1789683770.100910:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850313472 00000100:00100000:2.0:1789683770.100958:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683770.100967:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+3:22782:x1876618850313472:12345-0@lo:104: 00010000:00010000:2.0:1789683770.100979:0:22749:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.101032:0:22749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789683770.101038:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+3:22782:x1876618850313472:12345-0@lo:104: Request processed in 73us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683770.101044:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683770.101079:0:22782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850313472:0@lo:104: 00010000:00010000:2.0:1789683770.101099:0:22782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.101142:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683770.101147:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.101155:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9e00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683770.101159:0:22755:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.101168:0:22755:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683770.101175:0:22755:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683770.101181:0:22755:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789683770.101255:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:22745:1876618850313344:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789683770.101267:0:22745:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789683770.101276:0:22745:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789683770.101278:0:22745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789683770.101280:0:22745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683770.101281:0:22745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683770.101282:0:22745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683770.101284:0:22745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683770.101285:0:22745:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683770.101288:0:22745:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789683770.101291:0:22745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683770.101292:0:22745:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789683770.101306:0:22745:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789683770.101659:0:22755:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.101667:0:22755:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683770.101701:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.101709:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9e00/0xcf8485587b88b0e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b0ed expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.101726:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683770.101727:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683770.101729:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683770.101762:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850313600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683770.101834:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683770.101888:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850313600 00000100:00100000:2.0:1789683770.101893:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850313600 00010000:00010000:2.0:1789683770.101914:0:22751:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b0ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b0e6 expref: 12 pid: 22760 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683770.101940:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683770.101947:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acf86134-5469-4898-92a9-e106d5944cd1+12:3649:x1876618850313600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683770.101958:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683770.101964:0:22751:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b0ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b0e6 expref: 12 pid: 22760 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.101974:0:22751:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b0e6 expref: 12 pid: 22760 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.101987:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b0ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b0e6 expref: 12 pid: 22760 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.102000:0:22751:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.102009:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789683770.102023:0:22751:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001609877s 00010000:00010000:2.0:1789683770.102028:0:22751:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.102035:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.102053:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.102060:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.102066:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683770.102071:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.102079:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.102092:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.102101:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683770.102133:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acf86134-5469-4898-92a9-e106d5944cd1+11:3649:x1876618850313600:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683770.102140:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789683770.102164:0:22782:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.102172:0:22782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683770.102179:0:22782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b11e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683770.102495:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850313600:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789683770.143506:0:22745:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1789683770.143824:0:22745:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789683770.144038:0:22806:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1789683770.144041:0:22806:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1789683770.144406:0:22807:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789683770.144512:0:22745:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1789683770.144845:0:22808:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9f0e83db5180 x1876618850313728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683770.144857:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00000040:01000000:3.0:1789683770.145229:0:22745:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789683770.145267:0:22745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683770.145277:0:22807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683770.147468:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789683770.147553:0:22807:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:3.0:1789683770.149765:0:22745:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789683770.149844:0:22745:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789683770.149946:0:22745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683770.150982:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789683770.151537:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789683770.151570:0:22745:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789683770.163986:0:22745:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1789683770.164626:0:22745:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1789683770.172507:0:22745:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1789683770.175357:0:22745:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789683770.175413:0:22745:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba8340c97988 00100000:10000000:2.0:1789683770.175423:0:22745:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789683770.177509:0:22745:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789683770.177530:0:22745:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789683770.177553:0:22745:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789683770.177578:0:22745:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789683770.178293:0:22745:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683770.178542:0:22745:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789683770.530817:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789683771.047217:0:22763:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789683771.047227:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fc06b2000 from 11 10000000:01000000:3.0:1789683771.047234:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789683771.047288:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683771.047327:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683771.047341:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683771.047371:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850313856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683771.047449:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683771.047515:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683771.047898:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850313856 00000100:00100000:2.0:1789683771.047907:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850313856 00000100:00100000:2.0:1789683771.047967:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683771.047977:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+11:22763:x1876618850313856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683771.047994:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683771.048009:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b12c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b125 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683771.048033:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b125 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683771.048043:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b125 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683771.048052:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30c00, rc 0) 00000100:00100000:2.0:1789683771.048097:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+12:22763:x1876618850313856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683771.048104:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683771.048154:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850313856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683771.048177:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683771.048185:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683771.048241:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850313984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789683771.048273:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683771.048292:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f852cc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683771.048315:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850313984 00000100:00100000:2.0:1789683771.048319:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850313984 00000100:00100000:2.0:1789683771.048340:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683771.048346:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+12:22763:x1876618850313984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789683771.048361:0:22760:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789683771.048376:0:22760:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789683771.048379:0:22760:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789683771.048447:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+12:22763:x1876618850313984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683771.048453:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683771.048479:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850313984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789683771.048518:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789683771.048525:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683771.048535:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683771.106396:0:22800:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789683771.106407:0:22800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683771.108054:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789683771.108070:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789683771.174081:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:0.0:1789683771.552920:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683772.129576:0:22800:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789683772.129588:0:22800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683772.129721:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1789683772.129772:0:22800:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683772.129982:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1789683772.191620:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:0.0:1789683772.577205:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683773.216859:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:0.0:1789683773.598949:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683774.239465:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:1.0:1789683774.625206:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683775.071231:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789683775.071252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789683775.071256:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683775.071263:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 684 00000100:00080000:3.0:1789683775.071269:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683775.071281:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0fc148e800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683775.071311:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7e31c00 x1876618850314240/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683775.071329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683775.071333:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683775.071335:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683775.071338:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683775.071341:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789683775.071344:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789683775.071361:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fc06a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683775.071368:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f0fc06a5800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683775.071383:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7e30e00 x1876618850314368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683775.071405:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683775.071422:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850314112:0@lo:400:kworker.0 00000100:00100000:3.0:1789683775.071498:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683775.071555:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850314240:0@lo:38:kworker.0 00000100:00100000:3.0:1789683775.071590:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683775.071607:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850314368:0@lo:38:kworker.0 00000100:00100000:3.0:1789683775.071633:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683775.071666:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850314112 00000100:00100000:3.0:1789683775.071673:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850314112 00000100:00100000:3.0:1789683775.071721:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683775.071731:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+12:3649:x1876618850314112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683775.071801:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+12:3649:x1876618850314112:12345-0@lo:400:kworker.0 Request processed in 52us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683775.071809:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683775.071853:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850314368 00000100:00100000:3.0:1789683775.071857:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850314368 00000100:00100000:3.0:1789683775.071878:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683775.071882:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1876618850314368:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789683775.072127:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850314240 00000100:00100000:1.0:1789683775.072133:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850314240 00000100:00100000:1.0:1789683775.072155:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683775.072160:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850314240:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789683775.072172:0:22772:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789683775.072211:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850314240:12345-0@lo:38:kworker.0 Request processed in 50us (621us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789683775.072217:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789683775.072268:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789683775.072273:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789683775.072276:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850314240:0@lo:38:kworker.0 00010000:00080000:3.0:1789683775.072626:0:22768:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:3.0:1789683775.072673:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcf8485587b88b133 00000004:00100000:3.0:1789683775.072688:0:22768:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789683775.072859:0:22768:0:(import.c:65:import_set_state_nolock()) ffff9f0fc17f0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683775.076016:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876618850314368:12345-0@lo:38:kworker.0 Request processed in 4119us (4369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683775.076031:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683775.076122:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850314112:0@lo:400:kworker.0 00010000:00080000:1.0:1789683775.077765:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0fa7e30e00 x1876618850314368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789683775.077802:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789683775.077812:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789683775.077819:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789683775.077823:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc06a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789683775.077830:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850314368:0@lo:38:kworker.0 00000100:00100000:0.0:1789683775.274389:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:0.0:1789683775.652390:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683775.891537:0:23051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789683776.290915:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:3.0:1789683776.687334:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789683777.183937:0:23103:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683777.184230:0:23103:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789683777.313172:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:2.0:1789683777.701351:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789683778.325344:0:23153:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683778.325534:0:23153:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789683778.335624:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:3.0:1789683778.719064:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683779.364865:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:2.0:1789683779.748323:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683780.191680:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683770/real 1789683770] req@ffff9f0fa7de0a80 x1876618850311296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683780 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683780.191717:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fa7de0a80 x1876618850311296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683780 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683780.191729:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683770/real 1789683770] req@ffff9f0fc1c69500 x1876618850311168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683780 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683780.191738:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fc1c69500 x1876618850311168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683780 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789683780.191757:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c34000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683780.191766:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789683780.191770:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850311296:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789683780.191776:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0500000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683780.191780:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789683780.191813:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850311168:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789683780.192252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789683780.192259:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789683780.192262:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683780.192268:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 689 00000100:00080000:2.0:1789683780.192274:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789683780.192285:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0fc148e800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683780.192305:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83db5500 x1876618850314624/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683780.192316:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683780.192318:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789683780.192320:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0500000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683780.192323:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 684 00000100:00080000:2.0:1789683780.192326:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789683780.192330:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0fc0500000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683780.192341:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83db5f80 x1876618850314752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683780.192349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683780.192352:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789683780.192354:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c34000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683780.192357:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 684 00000100:00080000:2.0:1789683780.192377:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789683780.192382:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0e83c34000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683780.192394:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83db6680 x1876618850314880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683780.192542:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850314496:0@lo:400:kworker.0 00000100:00100000:0.0:1789683780.192627:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683780.192678:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683780.192684:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850315008:0@lo:400:kworker.0 00000100:00100000:0.0:1789683780.192729:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683780.192810:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850315008 00000100:00100000:0.0:1789683780.192817:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850315008 00000100:00100000:0.0:1789683780.192864:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683780.192872:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850315008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683780.192930:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850315008:12345-0@lo:400:kworker.0 Request processed in 59us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683780.192937:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789683780.192976:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0e83db6300 x1876618850315008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683780.192988:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850315008:0@lo:400:kworker.0 00000100:00100000:3.0:1789683780.193226:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850314624:0@lo:38:kworker.0 00000100:00100000:3.0:1789683780.193262:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683780.193303:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850314752:0@lo:8:kworker.0 00000400:00000100:3.0:1789683780.193327:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850314752 offset 0 length 520: 4 00000100:00100000:3.0:1789683780.193344:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850314880:0@lo:8:kworker.0 00000400:00000100:3.0:1789683780.193359:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850314880 offset 0 length 520: 4 00000100:00100000:0.0:1789683780.193441:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850314624 00000100:00100000:0.0:1789683780.193446:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850314624 00000100:00100000:0.0:1789683780.193479:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683780.193485:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850314624:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789683780.193503:0:22772:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789683780.193542:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850314624:12345-0@lo:38:kworker.0 Request processed in 56us (279us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789683780.193549:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789683780.193576:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683780.193580:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789683780.193583:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850314624:0@lo:38:kworker.0 00000100:00100000:2.0:1789683780.193828:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850314496 00000100:00100000:2.0:1789683780.193834:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850314496 00000100:00100000:2.0:1789683780.193876:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789683780.193885:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+12:3647:x1876618850314496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683780.193932:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+12:3647:x1876618850314496:12345-0@lo:400:kworker.0 Request processed in 49us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683780.193938:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789683780.197239:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850314496:0@lo:400:kworker.0 00000100:00100000:1.0:1789683780.384398:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:1.0:1789683780.770060:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683781.412300:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:2.0:1789683781.798428:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789683782.432615:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789683782.441972:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:3.0:1789683782.822010:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683783.464849:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:3.0:1789683783.839258:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683784.485998:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:3.0:1789683784.869753:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789683785.311098:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789683785.311117:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789683785.311122:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789683785.311131:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 694 00000100:00080000:0.0:1789683785.311137:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789683785.311149:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0fc148e800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683785.311176:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7de3b80 x1876618850315264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789683785.311195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683785.311198:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683785.311201:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683785.311203:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789683785.311244:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850315264:0@lo:38:kworker.0 00000100:00100000:0.0:1789683785.311311:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683785.311372:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850315264 00000100:00100000:0.0:1789683785.311381:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850315264 00000100:00100000:0.0:1789683785.311414:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789683785.311421:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850315264:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789683785.311441:0:22772:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789683785.311487:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850315264:12345-0@lo:38:kworker.0 Request processed in 65us (175us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789683785.311494:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789683785.311555:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683785.311560:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789683785.311565:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850315264:0@lo:38:kworker.0 00000100:00100000:2.0:1789683785.312680:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850315392:0@lo:400:kworker.0 00000100:00100000:2.0:1789683785.312728:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683785.312767:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683785.312773:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850315136:0@lo:400:kworker.0 00000100:00100000:2.0:1789683785.312827:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683785.312867:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850315136 00000100:00100000:2.0:1789683785.312873:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850315136 00000100:00100000:2.0:1789683785.312910:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789683785.312917:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+12:3650:x1876618850315136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683785.312965:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+12:3650:x1876618850315136:12345-0@lo:400:kworker.0 Request processed in 48us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683785.312972:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789683785.313028:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850315136:0@lo:400:kworker.0 00000100:00100000:0.0:1789683785.313212:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850315392 00000100:00100000:0.0:1789683785.313217:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850315392 00000100:00100000:0.0:1789683785.313246:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683785.313254:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850315392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683785.313296:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850315392:12345-0@lo:400:kworker.0 Request processed in 44us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683785.313303:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789683785.317885:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0fa7de0700 x1876618850315392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683785.317907:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850315392:0@lo:400:kworker.0 00000100:00100000:3.0:1789683785.505018:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:2.0:1789683785.889563:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683786.532905:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00000020:01000004:2.0:1789683786.801241:0:23500:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789683786.801246:0:23500:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789683786.801247:0:23500:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789683786.801380:0:23500:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0fa7d90800 00000020:01000004:2.0:1789683786.801394:0:23500:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789683786.801404:0:23500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789683786.801416:0:23500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9f0e83c299c0) 00000020:00000080:2.0:1789683786.801428:0:23500:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789683786.891899:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789683786.892697:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.893544:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.893750:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.894835:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.895192:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.895447:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.895721:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.896135:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.896359:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.897210:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.897409:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.897687:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.897916:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.898355:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.898537:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.898747:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.899054:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.899265:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.899471:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.899898:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.900408:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.900737:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.901376:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.901642:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.902097:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.902312:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.902529:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.902714:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.903090:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.903363:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789683786.903564:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.903751:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789683786.904158:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00010000:00010000:3.0:1789683786.911336:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789683786.917519:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789683786.919626:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789683786.923602:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789683786.924527:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789683786.924877:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789683786.925294:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789683786.925570:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789683786.925890:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789683786.926207:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789683786.926449:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789683786.926776:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789683786.927093:0:23500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1789683786.928443:0:23500:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789683786.928700:0:23500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789683786.928711:0:23500:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789683786.928724:0:23500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88b141 00000020:01000004:0.0:1789683786.928731:0:23500:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789683786.928754:0:23500:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789683786.928758:0:23500:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789683786.928764:0:23500:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789683786.928822:0:23500:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789683786.928826:0:23500:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789683786.937223:0:23500:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789683786.937289:0:23500:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.150@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789683786.937294:0:23500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789683786.937296:0:23500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789683786.937297:0:23500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683786.937298:0:23500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683786.937299:0:23500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683786.937301:0:23500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683786.937302:0:23500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683786.937304:0:23500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683786.937306:0:23500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789683786.937309:0:23500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789683786.937312:0:23500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683786.937313:0:23500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789683786.937314:0:23500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683786.937315:0:23500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683786.937316:0:23500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683786.937317:0:23500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683786.937318:0:23500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683786.937319:0:23500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683786.937320:0:23500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789683786.937357:0:23500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789683786.937379:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850315520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789683786.937471:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683786.937525:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88102600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683786.937684:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850315520 00000100:00100000:0.0:1789683786.937698:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850315520 00000100:00100000:0.0:1789683786.937758:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789683786.937767:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+12:23500:x1876618850315520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789683786.937850:0:22759:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789683786.937855:0:22759:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789683786.937863:0:22759:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789683786.938636:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+12:23500:x1876618850315520:12345-0@lo:253:mount.lustre.0 Request processed in 867us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683786.938647:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789683786.939413:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850315520:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789683786.939429:0:23500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789683786.939432:0:23500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789683786.939434:0:23500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789683786.939435:0:23500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683786.939436:0:23500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789683786.939437:0:23500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683786.939438:0:23500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683786.939440:0:23500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789683786.939441:0:23500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683786.939443:0:23500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789683786.939466:0:23500:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0fa7d90800 from lustre-MDT0001 10000000:01000000:1.0:1789683786.939560:0:23500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789683786.939564:0:23500:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789683786.939571:0:23500:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0f86180000 local copy 00010000:00010000:1.0:1789683786.939580:0:23500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683786.939671:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850315648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683786.939724:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683786.939814:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a363e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683786.939927:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850315648 00000100:00100000:2.0:1789683786.939993:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850315648 00000100:00100000:2.0:1789683786.940084:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789683786.940092:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+12:23500:x1876618850315648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683786.940173:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+12:23500:x1876618850315648:12345-0@lo:501:mount.lustre.0 Request processed in 82us (449us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683786.940179:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683786.940238:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850315648:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789683786.940251:0:23500:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789683786.940266:0:23500:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789683786.940272:0:23500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.940282:0:23500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683786.940306:0:23500:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0fa7d90800 10000000:01000000:1.0:1789683786.940311:0:23500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789683786.940316:0:23500:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f0f86180000 10000000:01000000:1.0:1789683786.940318:0:23500:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789683786.940321:0:23500:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f0f86180000 from 1 10000000:01000000:1.0:1789683786.940324:0:23500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789683786.940349:0:23500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8600/0xcf8485587b88b148 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.940357:0:23500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8600/0xcf8485587b88b148 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.940366:0:23500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8600/0xcf8485587b88b148 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683786.940379:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850315776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683786.940403:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683786.940535:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a363e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683786.940668:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850315776 00000100:00100000:3.0:1789683786.940674:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850315776 00000100:00100000:3.0:1789683786.940699:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683786.940705:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+12:23500:x1876618850315776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683786.940715:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683786.940743:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb1bc3e00/0xcf8485587b88b14f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b148 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683786.940765:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb1bc3e00/0xcf8485587b88b14f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b148 expref: 13 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683786.940776:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb1bc3e00/0xcf8485587b88b14f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b148 expref: 13 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683786.940802:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc3e00, rc 0) 00000100:00100000:3.0:1789683786.940842:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+13:23500:x1876618850315776:12345-0@lo:101:mount.lustre.0 Request processed in 137us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683786.940859:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683786.940951:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850315776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683786.940963:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8600/0xcf8485587b88b148 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b14f expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.940971:0:23500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8600/0xcf8485587b88b148 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b14f expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683786.940986:0:23500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789683786.941005:0:23500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8600/0xcf8485587b88b148 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b14f expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.941011:0:23500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8600/0xcf8485587b88b148 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b14f expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683786.941019:0:23500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0fa7d90800 10000000:01000000:1.0:1789683786.941032:0:23500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789683786.941036:0:23500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0fa7d90800 from 1 10000000:01000000:1.0:1789683786.941038:0:23500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789683786.941052:0:23500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b88b156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.941059:0:23500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b88b156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.941066:0:23500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b88b156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683786.941080:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850315904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683786.941106:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683786.941132:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a363e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683786.941189:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850315904 00000100:00100000:3.0:1789683786.941194:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850315904 00000100:00100000:3.0:1789683786.941215:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789683786.941221:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+13:23500:x1876618850315904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683786.941229:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683786.941237:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb1bc2e00/0xcf8485587b88b15d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b156 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683786.941251:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb1bc2e00/0xcf8485587b88b15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b156 expref: 14 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683786.941260:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb1bc2e00/0xcf8485587b88b15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b156 expref: 14 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683786.941267:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc2e00, rc 0) 00000100:00100000:3.0:1789683786.941302:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+14:23500:x1876618850315904:12345-0@lo:101:mount.lustre.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683786.941308:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789683786.941649:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850315904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683786.941661:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b88b156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b15d expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.941670:0:23500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b88b156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b15d expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683786.941681:0:23500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789683786.941694:0:23500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b88b156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b15d expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.941702:0:23500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b88b156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b15d expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683786.941708:0:23500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789683786.941712:0:23500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789683786.941717:0:23500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0fa7d90800 10000000:01000000:1.0:1789683786.941720:0:23500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789683786.941722:0:23500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789683786.941724:0:23500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789683786.941740:0:23500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b88b164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.941747:0:23500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b88b164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.941754:0:23500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b88b164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683786.941780:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850316032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683786.941839:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683786.941851:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a363e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683786.941925:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850316032 00000100:00100000:3.0:1789683786.941940:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850316032 00000100:00100000:3.0:1789683786.941963:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683786.941971:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+14:23500:x1876618850316032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683786.941979:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683786.941989:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb1bc3000/0xcf8485587b88b16b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b164 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683786.942003:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb1bc3000/0xcf8485587b88b16b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b164 expref: 15 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683786.942018:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb1bc3000/0xcf8485587b88b16b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b164 expref: 15 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683786.942035:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc3000, rc 0) 00000100:00100000:3.0:1789683786.942072:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+15:23500:x1876618850316032:12345-0@lo:101:mount.lustre.0 Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683786.942079:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789683786.942159:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850316032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683786.942170:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b88b164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b16b expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683786.942178:0:23500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b88b164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b16b expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683786.943752:0:23500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1789683786.944472:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683786.945452:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1789683786.945502:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1789683786.945521:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1789683786.945534:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1789683786.945546:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1789683786.945558:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1789683786.945571:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1789683786.945585:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1789683786.945599:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1789683786.945613:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1789683786.945636:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1789683786.945652:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1789683786.945668:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1789683786.945682:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1789683786.945697:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1789683786.945710:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1789683786.945726:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1789683786.945753:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1789683786.945768:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1789683786.945816:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1789683786.945833:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1789683786.945847:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1789683786.945865:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1789683786.945881:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1789683786.945896:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1789683786.945911:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1789683786.945925:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1789683786.945939:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1789683786.945952:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1789683786.945964:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1789683786.945975:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1789683786.945987:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1789683786.946029:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1789683786.946050:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1789683786.946066:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1789683786.946081:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1789683786.946095:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1789683786.946109:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1789683786.946121:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1789683786.946134:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1789683786.946149:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1789683786.946163:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1789683786.946178:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1789683786.946194:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1789683786.946217:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1789683786.946223:0:23500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1789683786.946320:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850316160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683786.946394:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683786.946432:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f86547540 going to sleep for 11 seconds 00000100:00100000:2.0:1789683786.946653:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850316160 00000100:00100000:2.0:1789683786.946661:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850316160 00000100:00100000:2.0:1789683786.946713:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789683786.946722:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+15:23500:x1876618850316160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683786.946908:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+15:23500:x1876618850316160:12345-0@lo:501:mount.lustre.0 Request processed in 186us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683786.946916:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789683786.947016:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850316160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683786.947060:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850316288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683786.947099:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683786.947126:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f86547540 going to sleep for 11 seconds 00000100:00100000:0.0:1789683786.947144:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850316288 00000100:00100000:0.0:1789683786.947149:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850316288 00000100:00100000:0.0:1789683786.947186:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789683786.947193:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+15:23500:x1876618850316288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683786.948147:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+15:23500:x1876618850316288:12345-0@lo:503:mount.lustre.0 Request processed in 952us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683786.948156:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789683786.950028:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850316288:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789683786.951566:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789683786.951661:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850316416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683786.951756:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683786.951832:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850316416 00000100:00100000:2.0:1789683786.951841:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850316416 00000100:00100000:2.0:1789683786.951891:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683786.951901:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+15:23500:x1876618850316416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683786.952037:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9249f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789683786.952591:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+15:23500:x1876618850316416:12345-0@lo:502:mount.lustre.0 Request processed in 691us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683786.952601:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789683786.952626:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850316416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683786.952866:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789683786.952915:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1789683786.953145:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1789683786.953167:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1789683786.953181:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1789683786.953193:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1789683786.953206:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1789683786.953219:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1789683786.953232:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1789683786.953244:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1789683786.953258:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1789683786.953273:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1789683786.953287:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1789683786.953325:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1789683786.953340:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1789683786.953441:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1789683786.953460:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1789683786.953493:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1789683786.953521:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1789683786.953534:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1789683786.953546:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1789683786.953559:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1789683786.953573:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1789683786.953588:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1789683786.953604:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1789683786.953618:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1789683786.953632:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1789683786.953644:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1789683786.953659:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1789683786.953674:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1789683786.953689:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1789683786.953704:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1789683786.953718:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1789683786.953748:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1789683786.953767:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1789683786.954480:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1789683786.954515:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1789683786.954531:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1789683786.954544:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1789683786.954559:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1789683786.954574:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1789683786.954588:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1789683786.954602:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1789683786.954617:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1789683786.954669:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850316544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683786.954753:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683786.954881:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9249f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789683786.955133:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850316544 00000100:00100000:0.0:1789683786.955142:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850316544 00000100:00100000:0.0:1789683786.955199:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789683786.955209:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+15:23500:x1876618850316544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683786.955619:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+15:23500:x1876618850316544:12345-0@lo:502:mount.lustre.0 Request processed in 411us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683786.955627:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789683786.955703:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850316544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683786.955766:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1789683786.955862:0:23500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789683786.956651:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683786.956662:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683786.956664:0:23504:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789683786.956670:0:23504:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789683786.956673:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683786.956688:0:23504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9f0e837a99c0) 00000020:00000080:1.0:1789683786.956707:0:23504:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789683786.956712:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789683786.956841:0:23504:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789683786.956848:0:23504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88b179 00000020:00000080:1.0:1789683786.957239:0:23504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789683786.957245:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683786.957249:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683786.957251:0:23504:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789683786.957255:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683786.957258:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683786.957259:0:23504:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789683786.957263:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683786.957272:0:23504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9f0e837ab380) 00000020:00000080:1.0:1789683786.957285:0:23504:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789683786.957289:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789683786.957292:0:23504:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789683786.957294:0:23504:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789683786.957317:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789683786.957515:0:23504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fa7d90800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789683786.957529:0:23504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9f0e837acd40) 00000020:00000080:1.0:1789683786.957539:0:23504:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789683786.957613:0:23504:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789683786.957622:0:23504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88b18e 00000020:00000080:1.0:1789683786.957719:0:23504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789683786.957726:0:23504:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789683786.957731:0:23504:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcf8485587b88b195 00080000:01000000:1.0:1789683786.957744:0:23504:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789683786.957748:0:23504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88b19c 00010000:00010000:0.0:1789683787.078278:0:23504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1789683787.082998:0:23504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1789683787.088389:0:23504:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789683787.091339:0:23504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789683787.091355:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683787.091364:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683787.091367:0:23504:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789683787.091370:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683787.091377:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683787.091378:0:23504:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789683787.091381:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789683787.091387:0:23504:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:00000080:1.0:1789683787.091419:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683787.091437:0:23504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9f0e837a8000) 00000020:00000080:1.0:1789683787.091462:0:23504:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789683787.091468:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789683787.091545:0:23504:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789683787.091553:0:23504:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789683787.091560:0:23504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88b1aa 00010000:00080000:1.0:1789683787.091602:0:23504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fb5180000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789683787.098992:0:23504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789683787.103956:0:23504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789683787.103973:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789683787.104027:0:23504:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789683787.104049:0:23504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88b1b1 00000100:00080000:1.0:1789683787.104060:0:23504:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683787.104072:0:23504:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0fb5180000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683787.104112:0:23504:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c69c00 x1876618850316672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683787.104142:0:23504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789683787.104174:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789683787.104185:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789683787.104187:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683787.104191:0:499:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 699 00000100:00080000:1.0:1789683787.104195:0:499:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789683787.104201:0:499:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0fc148e800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683787.104217:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c69500 x1876618850316800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683787.104228:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683787.104231:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683787.104234:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683787.104236:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789683787.104280:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850316928:0@lo:400:kworker.0 00000100:00100000:1.0:1789683787.104358:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1789683787.104445:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683787.104449:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683787.104452:0:23504:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789683787.104455:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789683787.104458:0:23504:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789683787.104460:0:23504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683787.104462:0:23504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683787.104464:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789683787.104466:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683787.104468:0:23504:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789683787.104471:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683787.104475:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683787.104477:0:23504:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789683787.104480:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789683787.104522:0:23504:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789683787.104545:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683787.104549:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683787.104550:0:23504:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789683787.104553:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789683787.104554:0:23504:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789683787.104556:0:23504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683787.104557:0:23504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683787.104558:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789683787.104561:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683787.104562:0:23504:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789683787.104564:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789683787.104567:0:23504:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789683787.104570:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683787.104571:0:23504:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789683787.104574:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789683787.104578:0:23504:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:1.0:1789683787.104598:0:23504:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789683787.104601:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683787.104616:0:23504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9f0fb504b380) 00000020:00000080:1.0:1789683787.104629:0:23504:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789683787.104635:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789683787.104691:0:23504:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789683787.104697:0:23504:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789683787.104703:0:23504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88b1bf 00010000:00080000:1.0:1789683787.104733:0:23504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0f8bdba000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789683787.104968:0:23504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1789683787.105119:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850316672:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789683787.105163:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683787.105203:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850316800:0@lo:38:kworker.0 00000100:00100000:2.0:1789683787.105228:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683787.105297:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850316672 00000100:00100000:2.0:1789683787.105305:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850316672 00000100:00100000:2.0:1789683787.105330:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850316800 00000100:00100000:2.0:1789683787.105333:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850316800 00000100:00100000:2.0:1789683787.105345:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683787.105352:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850316672:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789683787.105377:0:22772:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:2.0:1789683787.105411:0:22772:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88b1c6 00000004:00100000:2.0:1789683787.105425:0:22772:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789683787.105432:0:22772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1789683787.105605:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850316928 00000100:00100000:3.0:1789683787.105611:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850316928 00000100:00100000:3.0:1789683787.105650:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683787.105657:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850316928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683787.105709:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850316928:12345-0@lo:400:kworker.0 Request processed in 53us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683787.105715:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789683787.105758:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0fc1c6a300 x1876618850316928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683787.105772:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850316928:0@lo:400:kworker.0 00000040:01000000:1.0:1789683787.107229:0:23504:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789683787.107845:0:23504:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789683787.110305:0:23504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683787.110953:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1789683787.111119:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:1.0:1789683787.114668:0:22772:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683787.114886:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876618850316672:12345-0@lo:38:llog_process_th.0 Request processed in 9529us (9718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683787.114898:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683787.115010:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683787.115026:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850316800:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789683787.115087:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850316800:12345-0@lo:38:kworker.0 Request processed in 69us (9858us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789683787.115093:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683787.115187:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683787.115198:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789683787.115206:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789683787.115211:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789683787.115214:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5180000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789683787.115233:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850316672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789683787.115244:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683787.115247:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683787.115251:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789683787.115254:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850316800:0@lo:38:kworker.0 00000100:00100000:1.0:1789683787.115532:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683787.115544:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850317056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683787.115582:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683787.115614:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850317056 00000100:00100000:1.0:1789683787.115619:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850317056 00000100:00100000:1.0:1789683787.115651:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683787.115658:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1876618850317056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683787.115682:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789683787.115714:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1876618850317056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683787.115719:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683787.115748:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850317056:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789683787.117554:0:23509:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789683787.117561:0:23509:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789683787.119307:0:23504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789683787.119322:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789683787.119364:0:23504:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789683787.119386:0:23504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88b1cd 00000100:00080000:1.0:1789683787.119397:0:23504:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683787.119408:0:23504:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0f8bdba000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683787.119443:0:23504:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c6b100 x1876618850317184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683787.119462:0:23504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789683787.119544:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683787.119555:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683787.119557:0:23504:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789683787.119560:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789683787.119562:0:23504:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789683787.119564:0:23504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683787.119565:0:23504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683787.119567:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789683787.119569:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683787.119570:0:23504:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789683787.119573:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789683787.119577:0:23504:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789683787.119581:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683787.119582:0:23504:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789683787.119585:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789683787.119589:0:23504:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:1.0:1789683787.119609:0:23504:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789683787.119612:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683787.119623:0:23504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9f0fb504cd40) 00000020:00000080:1.0:1789683787.119635:0:23504:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789683787.119640:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1789683787.119694:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850317184:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1789683787.119696:0:23504:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789683787.119703:0:23504:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789683787.119708:0:23504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88b1db 00010000:00080000:1.0:1789683787.119738:0:23504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fb5185800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.150@tcp at head 00000400:00000100:0.0:1789683787.119746:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850317184 offset 0 length 520: 4 00010000:00010000:1.0:1789683787.119978:0:23504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789683787.120036:0:23504:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789683787.120049:0:23504:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1789683787.127061:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683787.127073:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683787.127076:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683787.127079:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789683787.127779:0:23504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683787.128298:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789683787.128425:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1789683787.129096:0:23511:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789683787.129101:0:23511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789683787.130188:0:23504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789683787.130204:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789683787.130253:0:23504:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789683787.130279:0:23504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88b1e2 00000100:00080000:3.0:1789683787.130290:0:23504:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683787.130301:0:23504:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0fb5185800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683787.130339:0:23504:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7e33480 x1876618850317312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683787.130382:0:23504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789683787.130471:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850317312:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789683787.130540:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850317312 offset 0 length 520: 4 00000020:01000000:3.0:1789683787.130705:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683787.130710:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.130712:0:23504:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789683787.130715:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683787.130719:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.130721:0:23504:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789683787.130723:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789683787.130725:0:23504:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789683787.130727:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683787.130730:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.130731:0:23504:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789683787.130733:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683787.130735:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.130737:0:23504:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789683787.130740:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789683787.130770:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683787.130774:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.130775:0:23504:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789683787.130779:0:23504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1789683787.131118:0:23500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789683787.131148:0:23500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789683787.131168:0:23500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b88b164 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b16b expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683787.131181:0:23500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b88b164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b16b expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683787.131204:0:23500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fa7d90800 from 1 10000000:01000000:2.0:1789683787.131206:0:23500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789683787.131236:0:23500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683787.131245:0:23500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683787.131256:0:23500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683787.131275:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850317440:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683787.131320:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683787.131358:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683787.131414:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850317440 00000100:00100000:0.0:1789683787.131422:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850317440 00000100:00100000:0.0:1789683787.131472:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789683787.131491:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+15:23500:x1876618850317440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683787.131504:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683787.131517:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b1f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b1e9 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683787.131541:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b1e9 expref: 16 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683787.131554:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b1e9 expref: 16 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683787.131576:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c800, rc 0) 00000100:00100000:0.0:1789683787.131615:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+16:23500:x1876618850317440:12345-0@lo:101:mount.lustre.0 Request processed in 135us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683787.131622:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789683787.131772:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850317440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683787.131819:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683787.131828:0:23500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683787.132455:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850317568:0@lo:256:mount.lustre.0 00000100:00080000:1.0:1789683787.133089:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683787.133103:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683787.133106:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683787.133109:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789683787.133291:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.133363:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683787.133402:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850317568 00000100:00100000:0.0:1789683787.133410:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850317568 00000100:00100000:0.0:1789683787.133860:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789683787.133871:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+16:23500:x1876618850317568:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789683787.133894:0:22759:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789683787.133913:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789683787.133916:0:22759:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1789683787.134095:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+16:23500:x1876618850317568:12345-0@lo:256:mount.lustre.0 Request processed in 226us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683787.134103:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683787.134176:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850317568:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789683787.134773:0:23500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683787.134888:0:23500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.134900:0:23500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683787.134909:0:23500:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fa7d90800 from 1 10000000:01000000:3.0:1789683787.134920:0:23500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683787.134963:0:23500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.134972:0:23500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.134982:0:23500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683787.135003:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850317696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789683787.135051:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.136307:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a366840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683787.136401:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850317696 00000100:00100000:2.0:1789683787.136412:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850317696 00000100:00100000:2.0:1789683787.136465:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789683787.136474:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+16:23500:x1876618850317696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683787.136518:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683787.136539:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b1fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b1f7 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683787.136569:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b1fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b1f7 expref: 17 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683787.136582:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b1fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b1f7 expref: 17 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683787.136591:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31a00, rc 0) 00000100:00100000:2.0:1789683787.136655:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+17:23500:x1876618850317696:12345-0@lo:101:mount.lustre.0 Request processed in 182us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683787.136661:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683787.136831:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850317696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683787.136848:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.136858:0:23500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683787.137897:0:23500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1789683787.138255:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683787.141800:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789683787.141863:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1789683787.141884:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1789683787.141899:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1789683787.141912:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1789683787.141925:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1789683787.141939:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1789683787.141953:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1789683787.141968:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789683787.142002:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1789683787.142027:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1789683787.142056:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1789683787.142063:0:23500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1789683787.142171:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850317824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683787.142241:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.142287:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a366e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683787.142360:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850317824 00000100:00100000:0.0:1789683787.142368:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850317824 00000100:00100000:0.0:1789683787.142497:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789683787.142508:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+17:23500:x1876618850317824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683787.142642:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+17:23500:x1876618850317824:12345-0@lo:501:mount.lustre.0 Request processed in 136us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683787.142650:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683787.142834:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850317824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683787.142870:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850317952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683787.142916:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.143194:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a366e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683787.143233:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850317952 00000100:00100000:1.0:1789683787.143238:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850317952 00000100:00100000:1.0:1789683787.143266:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789683787.143273:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+17:23500:x1876618850317952:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683787.143409:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+17:23500:x1876618850317952:12345-0@lo:503:mount.lustre.0 Request processed in 136us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683787.143417:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683787.143633:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850317952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789683787.147294:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789683787.147399:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683787.147950:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.147998:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a366840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683787.148074:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850318080 00000100:00100000:1.0:1789683787.148082:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850318080 00000100:00100000:1.0:1789683787.148137:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789683787.148146:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+17:23500:x1876618850318080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683787.148274:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+17:23500:x1876618850318080:12345-0@lo:502:mount.lustre.0 Request processed in 128us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683787.148283:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789683787.148416:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683787.148876:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789683787.148911:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1789683787.148926:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1789683787.148942:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1789683787.148958:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1789683787.148972:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1789683787.148985:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1789683787.148998:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1789683787.149012:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789683787.149046:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1789683787.149081:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1789683787.149119:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683787.149167:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683787.149201:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683787.149298:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850318208 00000100:00100000:3.0:1789683787.149304:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850318208 00000100:00100000:3.0:1789683787.149339:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789683787.149347:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+17:23500:x1876618850318208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683787.149446:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+17:23500:x1876618850318208:12345-0@lo:502:mount.lustre.0 Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683787.149453:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789683787.149667:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683787.149716:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1789683787.149725:0:23500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789683787.152949:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683787.152961:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.152964:0:23513:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789683787.152972:0:23513:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0fa7d90800 00000020:00000080:3.0:1789683787.152980:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683787.152988:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683787.152991:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.152993:0:23513:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789683787.152995:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683787.152998:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.152999:0:23513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789683787.153003:0:23513:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0fa7d90800 00000020:00000080:3.0:1789683787.153004:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683787.153065:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683787.153069:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.153070:0:23513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789683787.153073:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683787.153075:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.153076:0:23513:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789683787.153080:0:23513:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0fa7d90800 00000020:00000080:3.0:1789683787.153082:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683787.153099:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683787.153102:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.153103:0:23513:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789683787.153106:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683787.153108:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.153109:0:23513:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789683787.153113:0:23513:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0fa7d90800 00000020:00000080:3.0:1789683787.153115:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683787.153137:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683787.153141:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683787.153142:0:23513:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789683787.153145:0:23513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1789683787.157633:0:23500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789683787.157682:0:23500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683787.157710:0:23500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683787.157723:0:23500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683787.157803:0:23500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683787.157806:0:23500:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0fa7d90800 10000000:01000000:2.0:1789683787.157810:0:23500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0fa7d90800 10000000:01000000:2.0:1789683787.157814:0:23500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683787.157820:0:23500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0fa7d90800 from 1 10000000:01000000:2.0:1789683787.157823:0:23500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683787.157858:0:23500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31200/0xcf8485587b88b205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683787.157867:0:23500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31200/0xcf8485587b88b205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683787.157877:0:23500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31200/0xcf8485587b88b205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683787.157899:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683787.157967:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683787.158060:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49480 going to sleep for 11 seconds 00000100:00100000:0.0:1789683787.159591:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850318336 00000100:00100000:0.0:1789683787.159603:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850318336 00000100:00100000:0.0:1789683787.160597:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789683787.160612:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+17:23500:x1876618850318336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683787.160632:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683787.160658:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454d600/0xcf8485587b88b20c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b205 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683787.160687:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454d600/0xcf8485587b88b20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b205 expref: 18 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683787.160699:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454d600/0xcf8485587b88b20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b205 expref: 18 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683787.160708:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d600, rc 0) 00000100:00100000:0.0:1789683787.160801:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850318336:12345-0@lo:101:mount.lustre.0 Request processed in 193us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683787.160807:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789683787.165051:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683787.165084:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31200/0xcf8485587b88b205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b20c expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.165110:0:23500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31200/0xcf8485587b88b205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b20c expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683787.169585:0:23500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1789683787.170769:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683787.172592:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1789683787.172639:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1789683787.172654:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1789683787.172669:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1789683787.172684:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1789683787.172698:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1789683787.172712:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1789683787.172724:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1789683787.172736:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1789683787.172748:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1789683787.172762:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1789683787.172871:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1789683787.172889:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1789683787.172902:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1789683787.172913:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1789683787.172924:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1789683787.172937:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1789683787.172951:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1789683787.172962:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1789683787.172973:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1789683787.172985:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1789683787.172999:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1789683787.173013:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1789683787.173040:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1789683787.173053:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1789683787.173080:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1789683787.173092:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1789683787.173118:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1789683787.173133:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1789683787.173146:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1789683787.173159:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1789683787.173172:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1789683787.173186:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1789683787.173199:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1789683787.173211:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1789683787.173221:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1789683787.173231:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1789683787.173241:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1789683787.173251:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1789683787.173261:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1789683787.173271:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1789683787.173282:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1789683787.173295:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1789683787.173325:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1789683787.173341:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1789683787.173354:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1789683787.173367:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1789683787.173382:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1789683787.175709:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1789683787.175774:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1789683787.175825:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1789683787.175833:0:23500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1789683787.175952:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683787.176036:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.176076:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a3660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683787.176598:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850318464 00000100:00100000:0.0:1789683787.176605:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850318464 00000100:00100000:0.0:1789683787.176659:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789683787.176670:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850318464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683787.176842:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850318464:12345-0@lo:501:mount.lustre.0 Request processed in 174us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683787.176851:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789683787.177720:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683787.177845:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683787.177910:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.177983:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a3660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683787.188618:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850318592 00000100:00100000:0.0:1789683787.188635:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850318592 00000100:00100000:0.0:1789683787.188696:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789683787.188707:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850318592:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683787.188897:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850318592:12345-0@lo:503:mount.lustre.0 Request processed in 190us (10984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683787.188905:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789683787.189092:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318592:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789683787.189688:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789683787.189766:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683787.190672:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.190780:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a366a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683787.193595:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850318720 00000100:00100000:0.0:1789683787.193615:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850318720 00000100:00100000:3.0:1789683787.196008:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789683787.196029:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850318720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683787.196206:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850318720:12345-0@lo:502:mount.lustre.0 Request processed in 188us (5536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683787.196214:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789683787.196317:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683787.196648:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1789683787.196680:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1789683787.196691:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1789683787.196702:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1789683787.196712:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1789683787.196724:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1789683787.196735:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1789683787.196745:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1789683787.196755:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1789683787.196765:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1789683787.196776:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1789683787.196823:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1789683787.196836:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1789683787.196847:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1789683787.196857:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1789683787.196868:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1789683787.196878:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1789683787.196889:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1789683787.196899:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1789683787.196909:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1789683787.196919:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1789683787.196929:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1789683787.196943:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1789683787.196958:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1789683787.196971:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1789683787.196985:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1789683787.196998:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1789683787.197026:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1789683787.197043:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1789683787.197055:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1789683787.197082:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1789683787.197103:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1789683787.197115:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1789683787.197127:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1789683787.197138:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1789683787.197149:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1789683787.197161:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1789683787.197174:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1789683787.197187:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1789683787.197197:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1789683787.197210:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1789683787.197222:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1789683787.197234:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1789683787.197246:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1789683787.197259:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1789683787.197272:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1789683787.197300:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1789683787.197316:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1789683787.197366:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683787.197424:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683787.197469:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49780 going to sleep for 11 seconds 00000100:00100000:1.0:1789683787.197609:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850318848 00000100:00100000:1.0:1789683787.197618:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850318848 00000100:00100000:1.0:1789683787.197664:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789683787.197672:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850318848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683787.197805:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850318848:12345-0@lo:502:mount.lustre.0 Request processed in 133us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683787.197812:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789683787.197914:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683787.198097:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1789683787.198121:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1789683787.198145:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683787.198179:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683787.198238:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49780 going to sleep for 11 seconds 00000100:00100000:1.0:1789683787.200428:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850318976 00000100:00100000:1.0:1789683787.200449:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850318976 00000100:00100000:1.0:1789683787.201619:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789683787.201636:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850318976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683787.201816:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850318976:12345-0@lo:502:mount.lustre.0 Request processed in 187us (3636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683787.201824:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789683787.203043:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850318976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683787.203141:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1789683787.203156:0:23500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789683787.207275:0:23520:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789683787.207295:0:23520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9f0e83c2cd40) 00000020:00000080:2.0:1789683787.207318:0:23520:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789683787.207415:0:23520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fa7d90800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789683787.207419:0:23520:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0fa7d90800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789683787.207422:0:23520:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fa7d90800 3 00010000:00080000:2.0:1789683787.207463:0:23520:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e810cb800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789683787.210046:0:23520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789683787.210331:0:23520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789683787.210376:0:23520:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789683787.210389:0:23520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcf8485587b88b21a 00000100:00080000:2.0:1789683787.210399:0:23520:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789683787.210410:0:23520:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f0e810cb800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683787.210449:0:23520:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83db7100 x1876618850319104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683787.210550:0:23520:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789683787.210628:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683787.210635:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683787.210637:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683787.210640:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789683787.210813:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850319104:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789683787.210886:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683787.210986:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850319104 00000100:00100000:1.0:1789683787.210995:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850319104 00000100:00100000:1.0:1789683787.211044:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683787.211053:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850319104:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789683787.211079:0:22766:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:1.0:1789683787.211112:0:22766:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcf8485587b88b221 00000004:00100000:1.0:1789683787.211129:0:22766:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789683787.211163:0:22766:0:(import.c:65:import_set_state_nolock()) ffff9f0f89ca1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683787.211225:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876618850319104:12345-0@lo:38:llog_process_th.0 Request processed in 171us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683787.211233:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789683787.211312:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0e83db7100 x1876618850319104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683787.211322:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683787.211330:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789683787.211338:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789683787.211342:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789683787.211344:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e810cb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789683787.211350:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850319104:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789683787.211566:0:23520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1789683787.213652:0:23500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789683787.213697:0:23500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683787.213717:0:23500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31200/0xcf8485587b88b205 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b20c expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683787.213731:0:23500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31200/0xcf8485587b88b205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b20c expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789683787.213811:0:23500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789683787.213814:0:23500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789683787.213816:0:23500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683787.213817:0:23500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683787.213818:0:23500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683787.213819:0:23500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683787.213821:0:23500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683787.213828:0:23500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683787.213829:0:23500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683787.213833:0:23500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789683787.213836:0:23500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683787.213837:0:23500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789683787.213837:0:23500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683787.213838:0:23500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683787.213839:0:23500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683787.213840:0:23500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683787.213840:0:23500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683787.213841:0:23500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683787.213842:0:23500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683787.213870:0:23500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789683787.213888:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850319232:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789683787.215278:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683787.215334:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683787.217184:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850319232 00000100:00100000:0.0:1789683787.217198:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850319232 00000100:00100000:0.0:1789683787.217256:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789683787.217266:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850319232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789683787.217300:0:22759:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789683787.217315:0:22759:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789683787.224039:0:22746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789683787.224441:0:22759:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789683787.224459:0:22759:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789683787.224808:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+18:23500:x1876618850319232:12345-0@lo:253:mount.lustre.0 Request processed in 7514us (9505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683787.224823:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789683787.225009:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:23500:1876618850319232:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789683787.225034:0:23500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789683787.225037:0:23500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683787.225039:0:23500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789683787.225040:0:23500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683787.225041:0:23500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683787.225042:0:23500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683787.225043:0:23500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683787.225045:0:23500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683787.225053:0:23500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683787.225054:0:23500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789683787.225068:0:23500:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789683787.225971:0:22782:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789683787.225977:0:22782:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789683787.225999:0:22782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.226027:0:22782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b125 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.226036:0:22782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b1e9 expref: 17 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.226043:0:22782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.226092:0:22782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b1e9 expref: 17 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.226107:0:22782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b1f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b1e9 expref: 17 pid: 22760 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683787.226122:0:22782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850319360:0@lo:104: 00000100:00100000:3.0:1789683787.226174:0:22782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683787.226225:0:22782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b125 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.226233:0:22782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b12c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b125 expref: 17 pid: 22761 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683787.226241:0:22782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850319488:0@lo:104: 00000100:00100000:3.0:1789683787.226262:0:22782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.226283:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a366a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683787.226308:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850319360 00000100:00100000:3.0:1789683787.226315:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850319360 00000100:00100000:3.0:1789683787.226348:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850319488 00000100:00100000:3.0:1789683787.226351:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850319488 00000100:00100000:3.0:1789683787.226364:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683787.226371:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+4:22782:x1876618850319360:12345-0@lo:104: 00010000:00010000:3.0:1789683787.226385:0:22749:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.226435:0:22749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683787.226441:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+4:22782:x1876618850319360:12345-0@lo:104: Request processed in 70us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683787.226455:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683787.226471:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683787.226687:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+3:22782:x1876618850319488:12345-0@lo:104: 00010000:00010000:3.0:1789683787.226696:0:22749:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683787.226767:0:22749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683787.226773:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+3:22782:x1876618850319488:12345-0@lo:104: Request processed in 297us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683787.226779:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683787.226839:0:22782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850319360:0@lo:104: 00000100:00100000:3.0:1789683787.226847:0:22782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850319488:0@lo:104: 00010000:00010000:3.0:1789683787.226864:0:22782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.230350:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683787.230362:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.230373:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683787.230377:0:22754:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.230388:0:22754:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683787.230396:0:22754:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683787.230402:0:22754:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789683787.230589:0:22754:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.230597:0:22754:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683787.230618:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.230625:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30000/0xcf8485587b88b1e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b1f0 expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683787.230651:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850319616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683787.230714:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683787.230773:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850319616 00000100:00100000:1.0:1789683787.230780:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850319616 00010000:00010000:1.0:1789683787.230829:0:22751:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b1f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b1e9 expref: 18 pid: 22760 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683787.230871:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683787.230879:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acf86134-5469-4898-92a9-e106d5944cd1+18:3649:x1876618850319616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683787.230894:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683787.230899:0:22751:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b1f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b1e9 expref: 18 pid: 22760 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.230910:0:22751:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b1e9 expref: 18 pid: 22760 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.230924:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b1f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b1e9 expref: 18 pid: 22760 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.230937:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683787.230973:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acf86134-5469-4898-92a9-e106d5944cd1+17:3649:x1876618850319616:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683787.230980:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683787.231033:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850319616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683787.231052:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683787.231056:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231062:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3600 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683787.231065:0:22754:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231071:0:22754:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683787.231088:0:22754:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683787.231094:0:22754:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789683787.231119:0:22754:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231126:0:22754:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683787.231136:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231143:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b12c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683787.231160:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850319744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683787.231184:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683787.231212:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850319744 00000100:00100000:1.0:1789683787.231216:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850319744 00010000:00010000:1.0:1789683787.231229:0:22753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b12c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b125 expref: 17 pid: 22761 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683787.231246:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683787.231252:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acf86134-5469-4898-92a9-e106d5944cd1+17:3650:x1876618850319744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683787.231269:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683787.231274:0:22753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b12c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b125 expref: 17 pid: 22761 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231283:0:22753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b125 expref: 17 pid: 22761 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231300:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b12c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b125 expref: 17 pid: 22761 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231312:0:22753:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231320:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789683787.231335:0:22753:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005358220s 00010000:00010000:1.0:1789683787.231340:0:22753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231347:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231353:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231359:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231364:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683787.231369:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231376:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231391:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231408:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683787.231436:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acf86134-5469-4898-92a9-e106d5944cd1+16:3650:x1876618850319744:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683787.231442:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789683787.231465:0:22782:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231474:0:22782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683787.231480:0:22782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b228 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683787.231503:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850319744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683787.231516:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683787.231518:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683787.231520:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683787.233183:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789683787.233273:0:23500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1789683787.233581:0:23526:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1789683787.234075:0:23526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789683787.235028:0:23500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1789683787.235758:0:23527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23527:1876618850319872:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789683787.235856:0:23527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.235895:0:23527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a366300 going to sleep for 11 seconds 00000040:01000000:0.0:1789683787.236090:0:23500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789683787.236134:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789683787.236580:0:23500:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789683787.236587:0:23500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789683787.236622:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1789683787.239908:0:23525:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789683787.239916:0:23525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789683787.239942:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850319872 00000100:00100000:1.0:1789683787.239952:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850319872 00000100:00100000:1.0:1789683787.240014:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683787.240034:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23527:x1876618850319872:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789683787.240937:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789683787.241008:0:23526:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789683787.241235:0:23500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789683787.241812:0:23500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789683787.241844:0:23500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789683787.242011:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789683787.242579:0:23500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:1.0:1789683787.243037:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23527:x1876618850319872:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 2984us (7160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683787.243048:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683787.243657:0:23527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23527:1876618850319872:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789683787.243696:0:23527:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789683787.243744:0:23527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23527:1876618850320000:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789683787.243836:0:23527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.243862:0:23527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a366300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683787.243941:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850320000 00000100:00100000:0.0:1789683787.243949:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850320000 00000100:00100000:0.0:1789683787.243990:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789683787.243999:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23527:x1876618850320000:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789683787.244140:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23527:x1876618850320000:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 142us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683787.244147:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683787.244213:0:23527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23527:1876618850320000:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789683787.244266:0:23527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23527:1876618850320128:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789683787.244297:0:23527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.244318:0:23527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a366480 going to sleep for 11 seconds 00000100:00100000:0.0:1789683787.244427:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850320128 00000100:00100000:0.0:1789683787.244431:0:22777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850320128 00000100:00100000:0.0:1789683787.244465:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683787.244472:0:22777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23527:x1876618850320128:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789683787.244521:0:22777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23527:x1876618850320128:12345-0@lo:900:lod0001_rec0000.0 Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683787.244528:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789683787.244722:0:23527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0fa7e32680 x1876618850320128/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789683803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683787.244733:0:23527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23527:1876618850320128:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789683787.244774:0:23527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23527:1876618850320256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789683787.244829:0:23527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683787.244849:0:23527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a366300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683787.244909:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850320256 00000100:00100000:0.0:1789683787.244913:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850320256 00000100:00100000:0.0:1789683787.244938:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683787.244954:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23527:x1876618850320256:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789683787.245036:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23527:x1876618850320256:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683787.245043:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683787.245144:0:23527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23527:1876618850320256:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789683787.245188:0:23527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:1.0:1789683787.248292:0:23500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:3.0:1789683787.251441:0:23527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789683787.251591:0:23527:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789683787.251596:0:23527:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1789683787.264736:0:23500:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789683787.264777:0:23500:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffba8340c87988 00100000:10000000:1.0:1789683787.264817:0:23500:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789683787.269401:0:23500:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789683787.269438:0:23500:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789683787.269457:0:23500:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789683787.269485:0:23500:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789683787.270383:0:23500:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683787.270618:0:23500:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789683787.557775:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:2.0:1789683787.938772:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683788.275067:0:23519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789683788.575269:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 10000000:01000000:1.0:1789683788.769695:0:22763:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789683788.769704:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fa7d90800 from 12 10000000:01000000:1.0:1789683788.769709:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789683788.769762:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683788.769773:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683788.769803:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683788.769830:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850320384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683788.769915:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683788.769971:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9051bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683788.771505:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850320384 00000100:00100000:2.0:1789683788.771522:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850320384 00000100:00100000:2.0:1789683788.771593:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789683788.771603:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+16:22763:x1876618850320384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683788.771620:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683788.771641:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b22f expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683788.771674:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b22f expref: 17 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683788.771709:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b22f expref: 17 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683788.771718:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30200, rc 0) 00000100:00100000:2.0:1789683788.771866:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+17:22763:x1876618850320384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 264us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683788.771873:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789683788.772105:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850320384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683788.772131:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683788.772141:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683788.772220:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850320512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789683788.772262:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683788.772290:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9051bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683788.772425:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850320512 00000100:00100000:0.0:1789683788.772430:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850320512 00000100:00100000:0.0:1789683788.772466:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789683788.772484:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+17:22763:x1876618850320512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789683788.772503:0:22759:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683788.772522:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683788.772524:0:22759:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1789683788.772618:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+17:22763:x1876618850320512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683788.772626:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789683788.772746:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850320512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789683788.772842:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789683788.772851:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683788.772859:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683788.772868:0:22763:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789683788.772870:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fc06b2000 from 12 10000000:01000000:1.0:1789683788.772873:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789683788.772893:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683788.772901:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683788.772910:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683788.772924:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850320640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683788.772948:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683788.772968:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9051bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683788.772980:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850320640 00000100:00100000:1.0:1789683788.773001:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850320640 00000100:00100000:1.0:1789683788.773021:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789683788.773026:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+17:22763:x1876618850320640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683788.773034:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683788.773045:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88b244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b23d expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683788.773063:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88b244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b23d expref: 18 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683788.773071:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88b244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b23d expref: 18 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683788.773078:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9000, rc 0) 00000100:00100000:1.0:1789683788.773105:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+18:22763:x1876618850320640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683788.773111:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789683788.773139:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850320640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683788.773148:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683788.773155:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683788.773189:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850320768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789683788.773216:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683788.773228:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9051bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683788.773239:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850320768 00000100:00100000:1.0:1789683788.773246:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850320768 00000100:00100000:1.0:1789683788.773262:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789683788.773267:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8f78f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+18:22763:x1876618850320768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789683788.773276:0:22759:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789683788.773287:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789683788.773289:0:22759:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789683788.773364:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8f78f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+18:22763:x1876618850320768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683788.773371:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789683788.773396:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850320768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789683788.773429:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789683788.773434:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683788.773441:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683788.967369:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789683789.282286:0:23519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789683789.599757:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:1.0:1789683789.984022:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683790.622920:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:1.0:1789683791.007016:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683791.647029:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 0 seconds 00010000:00010000:1.0:1789683792.032092:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683792.407720:0:23769:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1789683792.479945:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789683792.479954:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789683792.479959:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683792.479978:0:499:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0fc148e800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683792.480006:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c6ad80 x1876618850321024/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683792.480028:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683792.480047:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683792.480050:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683792.480053:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683792.480085:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683792.480089:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683792.480091:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683792.480095:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789683792.480134:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850320896:0@lo:400:kworker.0 00000100:00100000:1.0:1789683792.480222:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683792.480287:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683792.480294:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850321152:0@lo:400:kworker.0 00000100:00100000:1.0:1789683792.480320:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683792.480353:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850321024:0@lo:38:kworker.0 00000100:00100000:1.0:1789683792.480380:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683792.480411:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850321280:0@lo:400:kworker.0 00000100:00100000:1.0:1789683792.480432:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683792.480449:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683792.480454:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850321408:0@lo:400:kworker.0 00000100:00100000:1.0:1789683792.480479:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683792.480508:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850320896 00000100:00100000:1.0:1789683792.480516:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850320896 00000100:00100000:1.0:1789683792.480561:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789683792.480569:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8f78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+18:3647:x1876618850320896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683792.480625:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8f78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+18:3647:x1876618850320896:12345-0@lo:400:kworker.0 Request processed in 56us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683792.480632:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789683792.480663:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850321024 00000100:00100000:1.0:1789683792.480667:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850321024 00000100:00100000:1.0:1789683792.480678:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850321280 00000100:00100000:1.0:1789683792.480680:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850321280 00000100:00100000:1.0:1789683792.480695:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683792.480700:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850321024:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789683792.480723:0:22772:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 706 last 0 00000020:00000080:1.0:1789683792.480762:0:22772:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88b24b 00000004:00100000:1.0:1789683792.480779:0:22772:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789683792.480805:0:22772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1789683792.480883:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850321152 00000100:00100000:1.0:1789683792.480887:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850321152 00000100:00100000:1.0:1789683792.480911:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850321408 00000100:00100000:1.0:1789683792.480914:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850321408 00000100:00100000:1.0:1789683792.480940:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683792.480945:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850321152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683792.480982:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850321152:12345-0@lo:400:kworker.0 Request processed in 37us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683792.480989:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683792.481002:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683792.481007:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850321408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683792.481036:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850321408:12345-0@lo:400:kworker.0 Request processed in 29us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683792.481042:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789683792.481086:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fc1c69f80 x1876618850321408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683792.481099:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850321408:0@lo:400:kworker.0 00010000:00080000:1.0:1789683792.481128:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fc1c68000 x1876618850321152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683792.481136:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850321152:0@lo:400:kworker.0 00000100:00100000:1.0:1789683792.481144:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850320896:0@lo:400:kworker.0 00000100:00100000:1.0:1789683792.481295:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850321536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683792.481319:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683792.483917:0:22771:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789683792.483948:0:22771:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789683792.484253:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850321536 00000100:00100000:3.0:1789683792.484264:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850321536 00000100:00100000:2.0:1789683792.484413:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683792.484424:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3649:x1876618850321280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683792.484523:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3649:x1876618850321280:12345-0@lo:400:kworker.0 Request processed in 100us (4089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683792.484530:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683792.484549:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789683792.484555:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850321536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683792.484580:0:23773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789683792.484631:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850321536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (3311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683792.484638:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683792.484708:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850321280:0@lo:400:kworker.0 00000100:00100000:3.0:1789683792.484811:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850321536:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789683792.497350:0:22772:0:(import.c:65:import_set_state_nolock()) ffff9f0e81fa8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683792.497459:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876618850321024:12345-0@lo:38:kworker.0 Request processed in 16755us (17076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683792.497471:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789683792.497567:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789683792.497576:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789683792.497581:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789683792.497597:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789683792.497642:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004b3856b0): req@ffff9f0e83db5180 x1876618850313728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683792.497658:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850321024:0@lo:38:kworker.0 00000100:00100000:0.0:1789683792.497762:0:22808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683792.497812:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683792.497895:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850313728 00000100:00100000:3.0:1789683792.497903:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850313728 00000100:00100000:3.0:1789683792.497945:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683792.497955:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22808:x1876618850313728:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789683792.498017:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22808:x1876618850313728:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 65us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683792.498027:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683792.498077:0:22808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22808:1876618850313728:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789683792.498114:0:22808:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789683792.498159:0:22808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22808:1876618850321664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789683792.498187:0:22808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683792.498219:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88afb900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683792.498268:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850321664 00000100:00100000:2.0:1789683792.498273:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850321664 00000100:00100000:2.0:1789683792.498305:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683792.498312:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22808:x1876618850321664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789683792.498408:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22808:x1876618850321664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 97us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683792.498416:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683792.498483:0:22808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22808:1876618850321664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789683792.498564:0:22808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22808:1876618850321792:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789683792.498596:0:22808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683792.498619:0:22808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88afb900 going to sleep for 11 seconds 00000100:00100000:3.0:1789683792.498940:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850321792 00000100:00100000:3.0:1789683792.498945:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850321792 00000100:00100000:3.0:1789683792.498972:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789683792.498978:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22808:x1876618850321792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789683792.499030:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22808:x1876618850321792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 53us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683792.499037:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789683792.499063:0:22808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22808:1876618850321792:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789683792.499103:0:22808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683792.504181:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789683792.504273:0:22808:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:3.0:1789683792.504279:0:22808:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1789683792.504617:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850321920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683792.504963:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683792.505049:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850321920 00000100:00100000:1.0:1789683792.505057:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850321920 00000100:00100000:1.0:1789683792.505108:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683792.505119:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850321920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683792.505159:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683792.505256:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850321920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683792.505264:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789683792.507661:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850321920:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789683792.675727:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789683793.056098:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789683793.471115:0:23823:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789683793.473460:0:23823:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789683794.081707:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789683794.524971:0:23873:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683794.525236:0:23873:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789683795.103009:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683795.550910:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683780/real 1789683780] req@ffff9f0e83db5f80 x1876618850314752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683795 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683795.550942:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0e83db5f80 x1876618850314752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683795 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683795.550951:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683780/real 1789683780] req@ffff9f0e83db6680 x1876618850314880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683795 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683795.550962:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0e83db6680 x1876618850314880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683795 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789683795.550986:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0500000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683795.551008:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789683795.551011:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850314752:0@lo:8:kworker.0 00000100:00080000:2.0:1789683795.551016:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c34000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683795.551029:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789683795.551031:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850314880:0@lo:8:kworker.0 00000100:00080000:1.0:1789683795.551183:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683795.551187:0:14530:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789683795.551190:0:14530:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0500000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683795.551195:0:14530:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 694 00000100:00080000:1.0:1789683795.551201:0:14530:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789683795.551212:0:14530:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0fc0500000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683795.551232:0:14530:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c69c00 x1876618850322304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683795.551246:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683795.551250:0:14530:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683795.551251:0:14530:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c34000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683795.551254:0:14530:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 694 00000100:00080000:1.0:1789683795.551257:0:14530:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789683795.551261:0:14530:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0e83c34000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683795.551272:0:14530:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc1c6a300 x1876618850322432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683795.551306:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683795.551309:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683795.551312:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683795.551315:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789683795.551343:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850322176:0@lo:400:kworker.0 00000100:00100000:1.0:1789683795.551406:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683795.551445:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789683795.551451:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850322048:0@lo:400:kworker.0 00000100:00100000:1.0:1789683795.551489:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683795.551511:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850322816:0@lo:400:kworker.0 00000100:00100000:1.0:1789683795.551535:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683795.551668:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850322560:0@lo:400:kworker.0 00000100:00100000:3.0:1789683795.551698:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683795.551718:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683795.551723:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850322688:0@lo:400:kworker.0 00000100:00100000:3.0:1789683795.551744:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683795.551918:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850322048 00000100:00100000:1.0:1789683795.551926:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850322048 00000100:00100000:1.0:1789683795.551977:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683795.551986:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+18:3650:x1876618850322048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683795.552034:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+18:3650:x1876618850322048:12345-0@lo:400:kworker.0 Request processed in 49us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683795.552041:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683795.552079:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850322816 00000100:00100000:1.0:1789683795.552082:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850322816 00000100:00100000:1.0:1789683795.552105:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850322560 00000100:00100000:1.0:1789683795.552108:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850322560 00000100:00100000:1.0:1789683795.552121:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683795.552127:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850322816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683795.552160:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850322816:12345-0@lo:400:kworker.0 Request processed in 33us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683795.552166:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683795.552179:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683795.552184:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850322560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683795.552216:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850322560:12345-0@lo:400:kworker.0 Request processed in 32us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683795.552222:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683795.552244:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850322176 00000100:00100000:1.0:1789683795.552248:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850322176 00000100:00100000:1.0:1789683795.552268:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850322688 00000100:00100000:1.0:1789683795.552279:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850322688 00000100:00100000:1.0:1789683795.552295:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683795.552301:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1876618850322176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683795.552348:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1876618850322176:12345-0@lo:400:kworker.0 Request processed in 47us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683795.552354:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683795.552368:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789683795.552373:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850322688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683795.552399:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850322688:12345-0@lo:400:kworker.0 Request processed in 26us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683795.552405:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789683795.552438:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850322688:0@lo:400:kworker.0 00010000:00080000:1.0:1789683795.552450:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fc1c6b480 x1876618850322560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683795.552459:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850322560:0@lo:400:kworker.0 00000100:00100000:1.0:1789683795.552490:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850322304:0@lo:8:kworker.0 00000400:00000100:1.0:1789683795.552515:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850322304 offset 0 length 520: 4 00000100:00100000:1.0:1789683795.552534:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850322432:0@lo:8:kworker.0 00000400:00000100:1.0:1789683795.554980:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850322432 offset 0 length 520: 4 00000100:00100000:1.0:1789683795.555090:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850322048:0@lo:400:kworker.0 00010000:00080000:1.0:1789683795.555112:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0e83eadc00 x1876618850322816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683795.555125:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850322816:0@lo:400:kworker.0 00000100:00100000:1.0:1789683795.555153:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850322176:0@lo:400:kworker.0 00000020:00000080:1.0:1789683795.929475:0:23921:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa82aee30 20000000:00000080:1.0:1789683795.929495:0:23921:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0fb1d9bc00 uarg=0000000000000000 20000000:01000000:1.0:1789683795.929619:0:23921:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789683795.929626:0:23921:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789683795.929631:0:23921:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789683795.930831:0:23922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789683795.931009:0:23921:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789683795.942454:0:23921:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789683795.942491:0:23921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683795.942585:0:23921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f8454c200/0xcf8485587b88b0fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b0f4 expref: 17 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683795.942596:0:23921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b1fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b1f7 expref: 17 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683795.942604:0:23921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683795.942653:0:23921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b1fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b1f7 expref: 17 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683795.942670:0:23921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b1fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b1f7 expref: 17 pid: 22760 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683795.942685:0:23921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23921:1876618850322944:0@lo:104: 00000100:00100000:2.0:1789683795.942755:0:23921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683795.943007:0:23921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f8454c200/0xcf8485587b88b0fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b0f4 expref: 17 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683795.943017:0:23921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f8454c200/0xcf8485587b88b0fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b0f4 expref: 17 pid: 22759 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683795.943046:0:23921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23921:1876618850323072:0@lo:104: 00000100:00100000:2.0:1789683795.943083:0:23921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683795.943662:0:23921:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88818240 going to sleep for 11 seconds 00000100:00100000:3.0:1789683795.943707:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850322944 00000100:00100000:3.0:1789683795.943716:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850322944 00000100:00100000:1.0:1789683795.943806:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850323072 00000100:00100000:1.0:1789683795.943811:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850323072 00000100:00100000:1.0:1789683795.943837:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683795.943845:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+4:23921:x1876618850322944:12345-0@lo:104: 00010000:00010000:1.0:1789683795.943858:0:22750:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683795.943932:0:22750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683795.943938:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+4:23921:x1876618850322944:12345-0@lo:104: Request processed in 94us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683795.943944:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683795.943961:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683795.943967:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+3:23921:x1876618850323072:12345-0@lo:104: 00010000:00010000:1.0:1789683795.943975:0:22750:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683795.944009:0:22750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789683795.944014:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+3:23921:x1876618850323072:12345-0@lo:104: Request processed in 48us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683795.944019:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789683795.944046:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683795.944052:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683795.944190:0:23921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23921:1876618850322944:0@lo:104: 00000100:00100000:2.0:1789683795.944199:0:23921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23921:1876618850323072:0@lo:104: 00010000:00010000:2.0:1789683795.944219:0:23921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.944292:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683795.944427:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683795.944432:0:22755:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683795.944441:0:22755:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683795.944448:0:22755:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683795.944453:0:22755:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789683795.944483:0:22755:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683795.944489:0:22755:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683795.944499:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683795.944505:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683795.944508:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.944512:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31400 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683795.944514:0:22754:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.944521:0:22754:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683795.944527:0:22754:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683795.944532:0:22754:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789683795.944591:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b1f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b1fe expref: -99 pid: 23500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683795.944605:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683795.944607:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683795.944608:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683795.944629:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850323200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683795.944666:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683795.944720:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850323200 00000100:00100000:1.0:1789683795.944725:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850323200 00010000:00010000:1.0:1789683795.944745:0:22753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b1fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b1f7 expref: 18 pid: 22760 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683795.944767:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683795.944773:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acf86134-5469-4898-92a9-e106d5944cd1+18:3650:x1876618850323200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683795.944802:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683795.944807:0:22753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b1fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b1f7 expref: 18 pid: 22760 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683795.944816:0:22753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b1fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b1f7 expref: 18 pid: 22760 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683795.944828:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b1fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b1f7 expref: 18 pid: 22760 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683795.944839:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683795.944885:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acf86134-5469-4898-92a9-e106d5944cd1+17:3650:x1876618850323200:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683795.944891:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683795.944922:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850323200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683795.945094:0:22754:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945101:0:22754:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683795.945129:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945137:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b0f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b0fb expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683795.945140:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1789683795.945163:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683795.945166:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683795.945167:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683795.945173:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683795.945174:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683795.945279:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850323328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683795.945306:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683795.945473:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850323328 00000100:00100000:0.0:1789683795.945478:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850323328 00010000:00010000:0.0:1789683795.945497:0:22752:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f8454c200/0xcf8485587b88b0fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b0f4 expref: 17 pid: 22759 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683795.945625:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683795.945633:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:acf86134-5469-4898-92a9-e106d5944cd1+17:3648:x1876618850323328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683795.945642:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683795.945647:0:22752:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f8454c200/0xcf8485587b88b0fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b0f4 expref: 17 pid: 22759 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945656:0:22752:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f8454c200/0xcf8485587b88b0fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b0f4 expref: 17 pid: 22759 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945668:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454c200/0xcf8485587b88b0fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b0f4 expref: 17 pid: 22759 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945679:0:22752:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945687:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945701:0:22752:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945716:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945722:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945728:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945733:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683795.945737:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.945744:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683795.945936:0:23921:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683795.945956:0:23921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.950284:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.950315:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb7a30c00/0xcf8485587b88b252 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683795.950455:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683795.952354:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:acf86134-5469-4898-92a9-e106d5944cd1+16:3648:x1876618850323328:12345-0@lo:103:ldlm_bl.0 Request processed in 6712us (7037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683795.952371:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683795.956973:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850323328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683796.131442:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683797.152289:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683797.598876:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683787/real 1789683787] req@ffff9f0fa7e33480 x1876618850317312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683797 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683797.598908:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fa7e33480 x1876618850317312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683797 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683797.598919:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683787/real 1789683787] req@ffff9f0fc1c6b100 x1876618850317184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683797 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683797.598934:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fc1c6b100 x1876618850317184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683797 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789683797.598953:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5185800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683797.598978:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789683797.598981:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850317312:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789683797.598987:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdba000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683797.598992:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789683797.598995:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850317184:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789683797.599159:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683797.599164:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683797.599182:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683797.599185:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683797.599204:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683797.599207:0:14530:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789683797.599210:0:14530:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdba000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683797.599216:0:14530:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 701 00000100:00080000:1.0:1789683797.599223:0:14530:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789683797.599235:0:14530:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0f8bdba000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683797.599258:0:14530:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83ead880 x1876618850323968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683797.599274:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683797.599276:0:14530:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683797.599278:0:14530:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5185800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683797.599281:0:14530:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 701 00000100:00080000:1.0:1789683797.599284:0:14530:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789683797.599288:0:14530:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0fb5185800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683797.599312:0:14530:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83ead500 x1876618850324096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683797.599345:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850323712:0@lo:400:kworker.0 00000100:00100000:1.0:1789683797.599407:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683797.599438:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683797.599444:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850323584:0@lo:400:kworker.0 00000100:00100000:1.0:1789683797.599470:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683797.599506:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850323712 00000100:00100000:1.0:1789683797.599522:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850323712 00000100:00100000:1.0:1789683797.599570:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683797.599580:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850323712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683797.599630:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850323712:12345-0@lo:400:kworker.0 Request processed in 51us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683797.599637:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683797.599662:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850323584 00000100:00100000:1.0:1789683797.599666:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850323584 00000100:00100000:1.0:1789683797.599690:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789683797.599696:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1876618850323584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683797.599729:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1876618850323584:12345-0@lo:400:kworker.0 Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683797.599735:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789683797.599761:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850323968:0@lo:8:kworker.0 00000400:00000100:1.0:1789683797.599813:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850323968 offset 0 length 520: 4 00000100:00100000:1.0:1789683797.599843:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850324096:0@lo:8:kworker.0 00000400:00000100:1.0:1789683797.599868:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850324096 offset 0 length 520: 4 00000100:00100000:1.0:1789683797.599903:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850323584:0@lo:400:kworker.0 00010000:00080000:1.0:1789683797.599913:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0e83eace00 x1876618850323712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683797.599923:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850323712:0@lo:400:kworker.0 00000100:00100000:2.0:1789683797.600137:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850323456:0@lo:400:kworker.0 00000100:00100000:2.0:1789683797.600179:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683797.600206:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850324224:0@lo:400:kworker.0 00000100:00100000:2.0:1789683797.600231:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683797.600249:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683797.600255:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850323840:0@lo:400:kworker.0 00000100:00100000:2.0:1789683797.600276:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683797.600312:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850324224 00000100:00100000:2.0:1789683797.600317:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850324224 00000100:00100000:2.0:1789683797.600341:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789683797.600348:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850324224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683797.600383:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850324224:12345-0@lo:400:kworker.0 Request processed in 36us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683797.600389:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789683797.600416:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0e83ead180 x1876618850324224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683797.600425:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850324224:0@lo:400:kworker.0 00000100:00100000:1.0:1789683797.600574:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850323456 00000100:00100000:1.0:1789683797.600578:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850323456 00000100:00100000:1.0:1789683797.600611:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789683797.600618:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+16:3648:x1876618850323456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683797.600661:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+16:3648:x1876618850323456:12345-0@lo:400:kworker.0 Request processed in 44us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683797.600668:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789683797.600701:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850323456:0@lo:400:kworker.0 00000100:00100000:3.0:1789683797.601259:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850323840 00000100:00100000:3.0:1789683797.601265:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850323840 00000100:00100000:3.0:1789683797.601302:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789683797.601310:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850323840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683797.601354:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850323840:12345-0@lo:400:kworker.0 Request processed in 45us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683797.601360:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789683797.601539:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850323840:0@lo:400:kworker.0 00000100:00100000:0.0:1789683797.601637:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850324352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683797.601671:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683797.601800:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850324352 00000100:00100000:1.0:1789683797.601804:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850324352 00000100:00100000:1.0:1789683797.601838:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789683797.601846:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850324352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683797.601870:0:23773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789683797.601905:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850324352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683797.601912:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683797.602137:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850324352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683797.602149:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683797.602155:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850324480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683797.602179:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683797.602377:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850324480 00000100:00100000:1.0:1789683797.602381:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850324480 00000100:00100000:1.0:1789683797.602415:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789683797.602422:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850324480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683797.602443:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683797.602479:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850324480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683797.602484:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789683797.602511:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850324480:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1789683797.669981:0:22763:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683797.669989:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fa7d90800 from 13 10000000:01000000:2.0:1789683797.669995:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683797.670042:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683797.670054:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683797.670065:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683797.670103:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850324608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683797.670175:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683797.670222:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789683797.672913:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850324608 00000100:00100000:3.0:1789683797.672927:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850324608 00000100:00100000:3.0:1789683797.673018:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789683797.673028:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+16:22763:x1876618850324608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683797.673046:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683797.673065:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb1bc2800/0xcf8485587b88b260 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b259 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683797.673107:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb1bc2800/0xcf8485587b88b260 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b259 expref: 17 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683797.673118:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb1bc2800/0xcf8485587b88b260 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b259 expref: 17 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683797.673127:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc2800, rc 0) 00000100:00100000:3.0:1789683797.673197:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+17:22763:x1876618850324608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (3022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683797.673218:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789683797.673288:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850324608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683797.673695:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683797.673707:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683797.673808:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850324736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683797.673856:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683797.673878:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a3660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683797.673896:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850324736 00000100:00100000:3.0:1789683797.673901:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850324736 00000100:00100000:3.0:1789683797.673928:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789683797.673934:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+17:22763:x1876618850324736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683797.674051:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+17:22763:x1876618850324736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683797.674058:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789683797.674200:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850324736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683797.674228:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850324864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683797.674273:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683797.674289:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a3660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683797.675589:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850324864 00000100:00100000:3.0:1789683797.675598:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850324864 00000100:00100000:3.0:1789683797.675653:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789683797.675676:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+17:22763:x1876618850324864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683797.675817:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+17:22763:x1876618850324864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683797.675825:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789683797.675894:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850324864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789683797.679939:0:23991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789683797.680301:0:22763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789683797.680326:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683797.680337:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683797.680350:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683797.680361:0:22763:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789683797.680364:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fc06b2000 from 13 10000000:01000000:3.0:1789683797.680368:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683797.680416:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683797.680424:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683797.680434:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683797.680460:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850324992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683797.680527:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683797.680573:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a3660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683797.680723:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850324992 00000100:00100000:2.0:1789683797.680731:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850324992 00000100:00100000:2.0:1789683797.680779:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789683797.680809:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+17:22763:x1876618850324992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683797.680825:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683797.680848:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a30400/0xcf8485587b88b26e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b267 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683797.680871:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a30400/0xcf8485587b88b26e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b267 expref: 18 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683797.680882:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb7a30400/0xcf8485587b88b26e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b267 expref: 18 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683797.680891:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30400, rc 0) 00000100:00100000:2.0:1789683797.680931:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+18:22763:x1876618850324992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683797.680938:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789683797.680983:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850324992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683797.680996:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683797.681005:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683797.681067:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850325120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683797.681094:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683797.681108:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789683797.681121:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850325120 00000100:00100000:2.0:1789683797.681124:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850325120 00000100:00100000:2.0:1789683797.681148:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789683797.681154:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:22763:x1876618850325120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683797.681260:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:22763:x1876618850325120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683797.681266:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789683797.681887:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850325120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683797.681926:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850325248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683797.681973:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683797.681990:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789683797.682007:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850325248 00000100:00100000:2.0:1789683797.682011:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850325248 00000100:00100000:2.0:1789683797.682037:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789683797.682044:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:22763:x1876618850325248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683797.682143:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:22763:x1876618850325248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683797.682149:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789683797.682190:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850325248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789683797.694162:0:23992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789683797.694917:0:22763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789683797.694943:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683797.694954:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683797.694967:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1789683798.113712:0:23501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789683798.177192:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683799.205044:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789683799.525207:0:23519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683800.224467:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683801.247006:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683802.275844:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683802.720298:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683802.720320:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850325376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683802.720388:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683802.720449:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850325376 00000100:00100000:0.0:1789683802.720456:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850325376 00000100:00100000:0.0:1789683802.720503:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683802.720512:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850325376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789683802.720544:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789683802.720591:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850325376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683802.720598:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683802.720645:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850325376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683802.722868:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850325504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683802.722947:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683802.723170:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850325504 00000100:00100000:2.0:1789683802.723185:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850325504 00000100:00100000:2.0:1789683802.723232:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683802.723242:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850325504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683802.723275:0:23773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789683802.723328:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850325504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683802.723335:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683802.723385:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850325504:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1789683802.727317:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683802.727358:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683802.727362:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683802.727365:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683802.727377:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683802.727380:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683802.727383:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683802.727386:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789683802.727418:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850325888:0@lo:400:kworker.0 00000100:00100000:3.0:1789683802.727484:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683802.727537:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850325888 00000100:00100000:3.0:1789683802.727545:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850325888 00000100:00100000:3.0:1789683802.727587:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683802.727595:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850325888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683802.727652:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850325888:12345-0@lo:400:kworker.0 Request processed in 58us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683802.727660:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789683802.727694:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fa7e33b80 x1876618850325888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683802.727707:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850325888:0@lo:400:kworker.0 00000100:00100000:0.0:1789683802.727953:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850325632:0@lo:400:kworker.0 00000100:00100000:0.0:1789683802.727990:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683802.728014:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683802.728019:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850325760:0@lo:400:kworker.0 00000100:00100000:0.0:1789683802.728050:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683802.728080:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850325760 00000100:00100000:0.0:1789683802.728084:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850325760 00000100:00100000:0.0:1789683802.728104:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683802.728109:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850325760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683802.728139:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850325760:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683802.728145:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789683802.728169:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fa7e31c00 x1876618850325760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683802.728179:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850325760:0@lo:400:kworker.0 00000100:00100000:3.0:1789683802.729013:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850325632 00000100:00100000:3.0:1789683802.729020:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850325632 00000100:00100000:3.0:1789683802.729120:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789683802.729128:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:3649:x1876618850325632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683802.729176:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:3649:x1876618850325632:12345-0@lo:400:kworker.0 Request processed in 50us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683802.729183:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789683802.729221:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850325632:0@lo:400:kworker.0 00000040:00080000:0.0:1789683802.911570:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683803.295042:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789683803.599739:0:24272:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789683803.599743:0:24272:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789683803.599745:0:24272:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789683803.599900:0:24272:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0f86d6b800 00000020:01000004:3.0:1789683803.599917:0:24272:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789683803.599933:0:24272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789683803.599947:0:24272:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f0fc04d8000) 00000020:00000080:3.0:1789683803.599966:0:24272:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789683803.803862:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789683803.807521:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789683803.810140:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789683803.810702:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789683803.816636:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789683803.818374:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789683803.819244:0:24272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1789683803.829409:0:24272:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789683803.829640:0:24272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789683803.829664:0:24272:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789683803.834912:0:24272:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf8485587b88b27c 00000020:01000004:3.0:1789683803.834932:0:24272:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789683803.834969:0:24272:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789683803.834973:0:24272:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789683803.834986:0:24272:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789683803.834991:0:24272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789683803.835166:0:24272:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f0e824099c0) 00000020:00000080:3.0:1789683803.835279:0:24272:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789683803.843057:0:24272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789683803.843298:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789683803.843305:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789683803.854130:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789683803.854147:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789683803.864276:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789683803.864294:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789683803.875552:0:24272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683803.875770:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789683803.875776:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789683803.881318:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789683803.881614:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789683803.911807:0:24272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683803.912158:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789683803.912165:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789683803.914420:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789683803.914434:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789683803.916475:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789683803.916490:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789683803.920405:0:24272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683803.920625:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789683803.920632:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789683803.924089:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789683803.924273:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789683803.973884:0:24272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683803.974102:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789683803.974110:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789683803.980661:0:24272:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789683803.980692:0:24272:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789683803.984040:0:24272:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789683803.984087:0:24272:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789683803.984093:0:24272:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789683804.007377:0:24272:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789683804.007418:0:24272:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.150@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789683804.007422:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789683804.007424:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789683804.007425:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683804.007426:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789683804.007428:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683804.007429:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683804.007430:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789683804.007432:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683804.007433:0:24272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789683804.007436:0:24272:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789683804.007438:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789683804.007440:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789683804.007441:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683804.007442:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789683804.007443:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683804.007444:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683804.007445:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789683804.007446:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683804.007447:0:24272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789683804.007485:0:24272:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789683804.007507:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789683804.007579:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.007625:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92462780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683804.007752:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850326016 00000100:00100000:3.0:1789683804.007762:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850326016 00000100:00100000:3.0:1789683804.007849:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789683804.007859:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+18:24272:x1876618850326016:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789683804.007894:0:22759:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789683804.007898:0:22759:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789683804.007902:0:22759:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789683804.008258:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+18:24272:x1876618850326016:12345-0@lo:253:mount.lustre.0 Request processed in 400us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683804.008267:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789683804.009004:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326016:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789683804.009019:0:24272:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789683804.009023:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789683804.009024:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789683804.009025:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683804.009026:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789683804.009027:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683804.009029:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683804.009030:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789683804.009032:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683804.009033:0:24272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789683804.009052:0:24272:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0f86d6b800 from lustre-OST0000 10000000:01000000:1.0:1789683804.009086:0:24272:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789683804.009089:0:24272:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789683804.009098:0:24272:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0f86180000 local copy 00010000:00010000:1.0:1789683804.009109:0:24272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683804.009335:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683804.009383:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.009422:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f836129c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683804.009495:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850326144 00000100:00100000:3.0:1789683804.009501:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850326144 00000100:00100000:3.0:1789683804.009589:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789683804.009598:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+18:24272:x1876618850326144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683804.009670:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+18:24272:x1876618850326144:12345-0@lo:501:mount.lustre.0 Request processed in 74us (287us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789683804.009695:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789683804.009768:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326144:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789683804.009781:0:24272:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789683804.009828:0:24272:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789683804.009836:0:24272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.009845:0:24272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683804.009870:0:24272:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0f86d6b800 10000000:01000000:1.0:1789683804.009875:0:24272:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789683804.009880:0:24272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789683804.009882:0:24272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789683804.009886:0:24272:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789683804.009888:0:24272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789683804.009911:0:24272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9400/0xcf8485587b88b28a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.009919:0:24272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9400/0xcf8485587b88b28a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.009940:0:24272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9400/0xcf8485587b88b28a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683804.009954:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683804.009979:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.015629:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f836129c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683804.015893:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850326272 00000100:00100000:2.0:1789683804.015904:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850326272 00000100:00100000:2.0:1789683804.015981:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789683804.015991:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+18:24272:x1876618850326272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683804.016009:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683804.016029:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a31000/0xcf8485587b88b291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b28a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683804.016059:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a31000/0xcf8485587b88b291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b28a expref: 19 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683804.016071:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb7a31000/0xcf8485587b88b291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b28a expref: 19 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683804.016081:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31000, rc 0) 00000100:00100000:2.0:1789683804.016195:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+19:24272:x1876618850326272:12345-0@lo:101:mount.lustre.0 Request processed in 205us (6214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683804.016202:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789683804.019363:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683804.019402:0:24272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9400/0xcf8485587b88b28a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b291 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.019415:0:24272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9400/0xcf8485587b88b28a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b291 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683804.021282:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1789683804.023371:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683804.026620:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789683804.026951:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789683804.026974:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789683804.026989:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789683804.027002:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789683804.027016:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789683804.027030:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789683804.027043:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789683804.027056:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1789683804.027069:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1789683804.027082:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1789683804.027095:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1789683804.027121:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1789683804.027127:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1789683804.027361:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683804.027431:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.027601:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92462780 going to sleep for 11 seconds 00000100:00100000:2.0:1789683804.027647:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850326400 00000100:00100000:2.0:1789683804.027655:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850326400 00000100:00100000:2.0:1789683804.027897:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789683804.027909:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+19:24272:x1876618850326400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683804.028077:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+19:24272:x1876618850326400:12345-0@lo:501:mount.lustre.0 Request processed in 171us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683804.028087:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789683804.028194:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683804.028230:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683804.028276:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683804.028601:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850326528 00000100:00100000:3.0:1789683804.028608:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850326528 00000100:00100000:3.0:1789683804.028637:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789683804.028644:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+19:24272:x1876618850326528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683804.029086:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92462780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683804.029538:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+19:24272:x1876618850326528:12345-0@lo:503:mount.lustre.0 Request processed in 892us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683804.029547:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789683804.029840:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326528:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789683804.030580:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789683804.030934:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683804.030999:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.031152:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683804.031294:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850326656 00000100:00100000:3.0:1789683804.031303:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850326656 00000100:00100000:3.0:1789683804.031345:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789683804.031354:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+19:24272:x1876618850326656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683804.032096:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+19:24272:x1876618850326656:12345-0@lo:502:mount.lustre.0 Request processed in 742us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683804.032105:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789683804.032209:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683804.032426:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789683804.032473:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789683804.032492:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789683804.032504:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789683804.032516:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789683804.032527:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789683804.032540:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789683804.032553:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789683804.032566:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1789683804.032578:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1789683804.032589:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1789683804.032601:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1789683804.032632:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683804.032912:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.032947:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683804.033009:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850326784 00000100:00100000:3.0:1789683804.033015:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850326784 00000100:00100000:3.0:1789683804.033044:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789683804.033052:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+19:24272:x1876618850326784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683804.033144:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+19:24272:x1876618850326784:12345-0@lo:502:mount.lustre.0 Request processed in 92us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683804.033150:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789683804.033260:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683804.033300:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1789683804.033309:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1789683804.035371:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789683804.035382:0:24289:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789683804.035388:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683804.035391:0:24289:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789683804.035398:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683804.035416:0:24289:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f0fb5048000) 00000020:00000080:1.0:1789683804.035443:0:24289:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789683804.035449:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789683804.035651:0:24289:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0f86d6b800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789683804.035660:0:24289:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789683804.035667:0:24289:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf8485587b88b29f 00010000:00010000:0.0:1789683804.052558:0:24289:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1789683804.053410:0:24289:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1789683804.057368:0:24289:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1789683804.058484:0:24289:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789683804.058496:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683804.058503:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683804.058506:0:24289:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789683804.058509:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789683804.058512:0:24289:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1789683804.058520:0:24289:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789683804.058522:0:24289:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789683804.058524:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789683804.058527:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683804.058529:0:24289:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789683804.058532:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683804.058535:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683804.058537:0:24289:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789683804.058540:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789683804.058542:0:24289:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789683804.058545:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683804.058547:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683804.058549:0:24289:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789683804.058551:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683804.058554:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683804.058555:0:24289:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789683804.058559:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789683804.058585:0:24289:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683804.058588:0:24289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683804.058589:0:24289:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789683804.058593:0:24289:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1789683804.058831:0:24272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789683804.058857:0:24272:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789683804.058878:0:24272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9400/0xcf8485587b88b28a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b291 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683804.058901:0:24272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9400/0xcf8485587b88b28a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b291 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683804.058909:0:24272:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f86d6b800 from 1 10000000:01000000:2.0:1789683804.058912:0:24272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683804.058954:0:24272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683804.058962:0:24272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683804.058975:0:24272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683804.059001:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683804.059066:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683804.059109:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f98ec2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789683804.061292:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850326912 00000100:00100000:3.0:1789683804.061308:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850326912 00000100:00100000:3.0:1789683804.061483:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789683804.061495:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+19:24272:x1876618850326912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683804.061520:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683804.061539:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb1bc2000/0xcf8485587b88b2ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b2a6 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683804.061569:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb1bc2000/0xcf8485587b88b2ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b2a6 expref: 20 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683804.061582:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb1bc2000/0xcf8485587b88b2ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b2a6 expref: 20 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683804.061591:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc2000, rc 0) 00000100:00100000:3.0:1789683804.061689:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+20:24272:x1876618850326912:12345-0@lo:101:mount.lustre.0 Request processed in 197us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683804.061697:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789683804.061805:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850326912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683804.061826:0:24272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.061836:0:24272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683804.078611:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1789683804.078976:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683804.080615:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789683804.080652:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789683804.080669:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789683804.080702:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789683804.080730:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789683804.080746:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789683804.080761:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789683804.080773:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1789683804.080814:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1789683804.080844:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1789683804.080871:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1789683804.080892:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1789683804.080898:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1789683804.080995:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683804.081071:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683804.081118:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f98ec2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683804.081280:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850327040 00000100:00100000:3.0:1789683804.081302:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850327040 00000100:00100000:3.0:1789683804.081348:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789683804.081357:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+20:24272:x1876618850327040:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683804.081757:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+20:24272:x1876618850327040:12345-0@lo:501:mount.lustre.0 Request processed in 400us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683804.081765:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789683804.082009:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683804.082045:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683804.082089:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683804.082116:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f98ec2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683804.082316:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850327168 00000100:00100000:3.0:1789683804.082321:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850327168 00000100:00100000:3.0:1789683804.082359:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683804.082365:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+20:24272:x1876618850327168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683804.082653:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327168:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789683804.083128:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683804.083598:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683804.083649:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683804.083729:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f98ec2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683804.084220:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+20:24272:x1876618850327168:12345-0@lo:503:mount.lustre.0 Request processed in 106us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683804.084243:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683804.084287:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850327296 00000100:00100000:3.0:1789683804.084294:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850327296 00000100:00100000:0.0:1789683804.084701:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789683804.084723:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+20:24272:x1876618850327296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683804.085055:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+20:24272:x1876618850327296:12345-0@lo:502:mount.lustre.0 Request processed in 344us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683804.085062:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789683804.085311:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683804.086120:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789683804.086160:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789683804.086252:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789683804.086270:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789683804.086283:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789683804.086297:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789683804.086308:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789683804.086321:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789683804.086334:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789683804.086347:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789683804.086359:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789683804.086403:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683804.086614:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683804.086706:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fa037d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683804.086972:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850327424 00000100:00100000:0.0:1789683804.086980:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850327424 00000100:00100000:1.0:1789683804.087147:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789683804.087157:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+20:24272:x1876618850327424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683804.087296:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+20:24272:x1876618850327424:12345-0@lo:502:mount.lustre.0 Request processed in 140us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683804.087304:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789683804.087394:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683804.087479:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1789683804.087491:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789683804.088610:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683804.088620:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683804.088622:0:24293:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789683804.088628:0:24293:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0f86d6b800 00000020:00000080:2.0:1789683804.088631:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789683804.088640:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683804.088642:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683804.088654:0:24293:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789683804.088657:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683804.088659:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683804.088661:0:24293:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789683804.088664:0:24293:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0f86d6b800 00000020:00000080:2.0:1789683804.088667:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789683804.088746:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683804.088750:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683804.088751:0:24293:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789683804.088754:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683804.088757:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683804.088758:0:24293:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789683804.088761:0:24293:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0f86d6b800 00000020:00000080:2.0:1789683804.088763:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789683804.088781:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683804.088803:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683804.088805:0:24293:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789683804.088808:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683804.088810:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683804.088811:0:24293:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789683804.088814:0:24293:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0f86d6b800 00000020:00000080:2.0:1789683804.088817:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789683804.088841:0:24293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683804.088844:0:24293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683804.088846:0:24293:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789683804.088849:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1789683804.098845:0:24272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789683804.098902:0:24272:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789683804.098937:0:24272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.098953:0:24272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683804.099025:0:24272:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789683804.099029:0:24272:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0f86d6b800 10000000:01000000:1.0:1789683804.099032:0:24272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0f86d6b800 10000000:01000000:1.0:1789683804.099036:0:24272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789683804.099042:0:24272:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0f86d6b800 from 1 10000000:01000000:1.0:1789683804.099045:0:24272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789683804.099084:0:24272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88b2b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.099092:0:24272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88b2b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.099103:0:24272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88b2b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683804.099130:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683804.101848:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.101897:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683804.102807:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850327552 00000100:00100000:0.0:1789683804.102824:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850327552 00000100:00100000:0.0:1789683804.102888:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789683804.102899:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+20:24272:x1876618850327552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683804.102930:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683804.102953:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454dc00/0xcf8485587b88b2bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b2b4 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683804.102983:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454dc00/0xcf8485587b88b2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b2b4 expref: 21 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683804.102996:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454dc00/0xcf8485587b88b2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b2b4 expref: 21 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683804.103006:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454dc00, rc 0) 00000100:00100000:0.0:1789683804.103075:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850327552:12345-0@lo:101:mount.lustre.0 Request processed in 178us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683804.103082:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789683804.103362:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683804.103381:0:24272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88b2b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b2bb expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.103392:0:24272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88b2b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b2bb expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683804.111762:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1789683804.112109:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683804.113945:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789683804.113980:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789683804.113994:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789683804.114009:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789683804.114023:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789683804.114034:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789683804.114047:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789683804.114060:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789683804.114075:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789683804.114089:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789683804.114102:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789683804.114117:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789683804.114134:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789683804.114149:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789683804.115641:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789683804.115677:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789683804.115693:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789683804.115707:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789683804.115734:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789683804.115751:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789683804.115764:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789683804.115778:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789683804.116331:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789683804.116349:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789683804.116364:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1789683804.116378:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1789683804.116393:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1789683804.116406:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1789683804.116421:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1789683804.116448:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1789683804.116932:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1789683804.116951:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1789683804.116963:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1789683804.116977:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1789683804.116990:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1789683804.117003:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1789683804.117018:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1789683804.117035:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1789683804.117050:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1789683804.117061:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1789683804.117073:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1789683804.117085:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1789683804.117098:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1789683804.117110:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1789683804.117122:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1789683804.117136:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1789683804.117166:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1789683804.117200:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1789683804.117376:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1789683804.117398:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1789683804.117417:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1789683804.117423:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1789683804.117550:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683804.117629:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.117683:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850327680 00000100:00100000:1.0:1789683804.117690:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850327680 00000100:00100000:1.0:1789683804.117751:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789683804.117779:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850327680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683804.117933:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850327680:12345-0@lo:501:mount.lustre.0 Request processed in 173us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683804.117951:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789683804.118078:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683804.118100:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683804.118132:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683804.118171:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.118194:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850327808 00000100:00100000:1.0:1789683804.118199:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850327808 00000100:00100000:1.0:1789683804.118223:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789683804.118230:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850327808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683804.118305:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850327808:12345-0@lo:503:mount.lustre.0 Request processed in 75us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683804.118312:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789683804.118357:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683804.118371:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327808:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789683804.120754:0:24272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789683804.120865:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683804.120957:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.121007:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850327936 00000100:00100000:1.0:1789683804.121014:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850327936 00000100:00100000:1.0:1789683804.121056:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789683804.121065:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850327936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683804.123400:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850327936:12345-0@lo:502:mount.lustre.0 Request processed in 2325us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683804.123416:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789683804.123558:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612300 going to sleep for 11 seconds 00000100:00100000:1.0:1789683804.123591:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850327936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683804.123899:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789683804.123931:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789683804.123947:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789683804.123961:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789683804.123974:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789683804.123988:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789683804.124002:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789683804.124016:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789683804.124051:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789683804.124067:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789683804.124080:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789683804.124093:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789683804.124107:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789683804.124122:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789683804.124133:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789683804.124145:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789683804.124159:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789683804.125822:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789683804.125870:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789683804.125885:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789683804.125898:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789683804.125912:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789683804.125924:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789683804.125937:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789683804.125966:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789683804.125981:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789683804.125993:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789683804.126004:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789683804.126017:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789683804.126030:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789683804.126055:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789683804.126069:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789683804.126083:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789683804.126096:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789683804.126669:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789683804.126690:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789683804.126705:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789683804.126730:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789683804.126746:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789683804.126759:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789683804.126803:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789683804.126822:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789683804.126839:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789683804.126853:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789683804.126868:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789683804.126883:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789683804.126896:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789683804.126910:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789683804.126975:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850328064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683804.127053:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.127095:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850328064 00000100:00100000:1.0:1789683804.127102:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850328064 00000100:00100000:1.0:1789683804.127148:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789683804.127157:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850328064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683804.127664:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850328064:12345-0@lo:502:mount.lustre.0 Request processed in 507us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683804.127673:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789683804.127736:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612300 going to sleep for 11 seconds 00000100:00100000:1.0:1789683804.127762:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850328064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683804.127974:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1789683804.127995:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1789683804.128018:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850328192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683804.128054:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.128080:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850328192 00000100:00100000:1.0:1789683804.128085:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850328192 00000100:00100000:1.0:1789683804.128113:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789683804.128119:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850328192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683804.130385:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850328192:12345-0@lo:502:mount.lustre.0 Request processed in 2256us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683804.130399:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789683804.130616:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88102600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683804.130643:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850328192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683804.130742:0:24272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789683804.130757:0:24272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789683804.154354:0:24298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789683804.154374:0:24298:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f0e82408000) 00000020:00000080:3.0:1789683804.154398:0:24298:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1789683804.154501:0:24298:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0f86d6b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789683804.154505:0:24298:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0f86d6b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789683804.154508:0:24298:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0f86d6b800 3 00010000:00080000:3.0:1789683804.154539:0:24298:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e8108e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789683804.156169:0:24298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1789683804.156361:0:24298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789683804.156400:0:24298:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789683804.156412:0:24298:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcf8485587b88b2c9 00000100:00080000:3.0:1789683804.156423:0:24298:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683804.156433:0:24298:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0e8108e000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683804.156480:0:24298:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7e33b80 x1876618850328320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683804.156520:0:24298:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789683804.158407:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850328320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789683804.158638:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789683804.158758:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683804.158763:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683804.158765:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683804.158778:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683804.158827:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683804.158831:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683804.158833:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683804.158836:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789683804.158879:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850328448:0@lo:400:kworker.0 00000100:00100000:2.0:1789683804.158913:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683804.158936:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683804.158942:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850328832:0@lo:400:kworker.0 00000100:00100000:2.0:1789683804.158980:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683804.159015:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850328576:0@lo:400:kworker.0 00000100:00100000:2.0:1789683804.159038:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683804.159056:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683804.159061:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850328704:0@lo:400:kworker.0 00000100:00100000:2.0:1789683804.159081:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683804.159119:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850328448 00000100:00100000:2.0:1789683804.159126:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850328448 00000100:00100000:2.0:1789683804.159165:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850328704 00000100:00100000:2.0:1789683804.159168:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850328704 00000100:00100000:0.0:1789683804.159345:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850328320 00000100:00100000:0.0:1789683804.159350:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850328320 00000100:00100000:0.0:1789683804.159363:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850328832 00000100:00100000:0.0:1789683804.159365:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850328832 00000100:00100000:0.0:1789683804.159380:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850328576 00000100:00100000:0.0:1789683804.159383:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850328576 00000100:00100000:0.0:1789683804.159396:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683804.159403:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850328832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683804.159646:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850328832:12345-0@lo:400:kworker.0 Request processed in 67us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683804.159655:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683804.159673:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683804.159679:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850328576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683804.159726:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850328576:12345-0@lo:400:kworker.0 Request processed in 36us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683804.159740:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683804.159752:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789683804.159756:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876618850328320:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789683804.159778:0:22767:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:0.0:1789683804.159830:0:22767:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcf8485587b88b2d0 00000004:00100000:0.0:1789683804.159847:0:22767:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789683804.159879:0:22767:0:(import.c:65:import_set_state_nolock()) ffff9f0e825e7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683804.159919:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876618850328320:12345-0@lo:38:llog_process_th.0 Request processed in 161us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683804.159925:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683804.160078:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683804.160085:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850328448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683804.160123:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850328448:12345-0@lo:400:kworker.0 Request processed in 39us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683804.160129:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683804.160142:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683804.160157:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850328704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683804.160327:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850328704:12345-0@lo:400:kworker.0 Request processed in 171us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683804.160333:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789683804.160381:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0e83db7480 x1876618850328832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683804.160394:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850328832:0@lo:400:kworker.0 00000100:00100000:2.0:1789683804.160405:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850328448:0@lo:400:kworker.0 00000100:00100000:2.0:1789683804.160432:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850328704:0@lo:400:kworker.0 00010000:00080000:2.0:1789683804.160442:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0e83db6300 x1876618850328576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683804.160462:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850328576:0@lo:400:kworker.0 00010000:00080000:2.0:1789683804.160623:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fa7e33b80 x1876618850328320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683804.160631:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789683804.160637:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789683804.160645:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789683804.160650:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789683804.160653:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e8108e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789683804.160658:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850328320:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1789683804.162374:0:24298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789683804.162391:0:24298:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9f0e8240cd40) 00000020:00000080:3.0:1789683804.162414:0:24298:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789683804.162508:0:24298:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0f86d6b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789683804.162512:0:24298:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0f86d6b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789683804.162514:0:24298:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0f86d6b800 3 00010000:00080000:3.0:1789683804.162543:0:24298:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e8108e800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789683804.164212:0:24298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789683804.164405:0:24298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789683804.164449:0:24298:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789683804.164461:0:24298:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcf8485587b88b2de 00000100:00080000:3.0:1789683804.164471:0:24298:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683804.164483:0:24298:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f0e8108e800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683804.164520:0:24298:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7e33b80 x1876618850328960/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683804.164560:0:24298:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789683804.164779:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1876618850328960:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789683804.164875:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789683804.164948:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683804.164953:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683804.164955:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683804.164958:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683804.164961:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683804.164964:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683804.164967:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683804.164969:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789683804.178973:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850328960 00000100:00100000:3.0:1789683804.178989:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850328960 00000100:00100000:3.0:1789683804.179058:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683804.179067:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876618850328960:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789683804.179100:0:22767:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:3.0:1789683804.179166:0:22767:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcf8485587b88b2e5 00000004:00100000:3.0:1789683804.179185:0:22767:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789683804.179222:0:22767:0:(import.c:65:import_set_state_nolock()) ffff9f0e8343d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683804.179325:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876618850328960:12345-0@lo:38:llog_process_th.0 Request processed in 258us (14450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683804.179332:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1789683804.179437:0:24298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:1.0:1789683804.179616:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fa7e33b80 x1876618850328960/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683804.179628:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789683804.179636:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1789683804.179644:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789683804.179649:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789683804.179652:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e8108e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789683804.179658:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1876618850328960:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1789683804.179689:0:24272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789683804.179729:0:24272:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789683804.179760:0:24272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88b2b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b2bb expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.179771:0:24272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88b2b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b2bb expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789683804.179844:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789683804.179846:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789683804.179847:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683804.179848:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789683804.179849:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683804.179850:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683804.179852:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789683804.179854:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683804.179855:0:24272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789683804.179859:0:24272:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789683804.179861:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789683804.179862:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789683804.179864:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683804.179864:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789683804.179866:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683804.179867:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683804.179868:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789683804.179868:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683804.179869:0:24272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789683804.179886:0:24272:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789683804.179901:0:24272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850329088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789683804.179943:0:24272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.179970:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850329088 00000100:00100000:1.0:1789683804.179975:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850329088 00000100:00100000:1.0:1789683804.180002:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789683804.180009:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850329088:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789683804.180029:0:22759:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789683804.180042:0:22759:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789683804.180290:0:24272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88102d80 going to sleep for 11 seconds 20000000:01000000:3.0:1789683804.181759:0:22759:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789683804.181776:0:22759:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789683804.182100:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+21:24272:x1876618850329088:12345-0@lo:253:mount.lustre.0 Request processed in 2088us (2153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683804.182110:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789683804.182204:0:24272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:24272:1876618850329088:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789683804.182217:0:24272:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789683804.182220:0:24272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683804.182222:0:24272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683804.182223:0:24272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683804.182224:0:24272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683804.182225:0:24272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683804.182227:0:24272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683804.182228:0:24272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683804.182230:0:24272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683804.182231:0:24272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789683804.182246:0:24272:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789683804.183046:0:22782:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789683804.183051:0:22782:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789683804.183073:0:22782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183090:0:22782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b22f expref: 20 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183097:0:22782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88b244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b23d expref: 20 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183104:0:22782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183137:0:22782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88b244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b23d expref: 20 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183153:0:22782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88b244 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b23d expref: 20 pid: 22759 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683804.183166:0:22782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850329216:0@lo:104: 00000100:00100000:1.0:1789683804.183220:0:22782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683804.183269:0:22782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b22f expref: 20 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183278:0:22782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b22f expref: 20 pid: 22760 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683804.183286:0:22782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850329344:0@lo:104: 00000100:00100000:1.0:1789683804.183309:0:22782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.183333:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683804.183357:0:22750:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789683804.183369:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850329216 00000100:00100000:1.0:1789683804.183375:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850329216 00000100:00100000:1.0:1789683804.183402:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850329344 00000100:00100000:1.0:1789683804.183405:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850329344 00000100:00100000:1.0:1789683804.183418:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683804.183426:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+4:22782:x1876618850329216:12345-0@lo:104: 00010000:00010000:1.0:1789683804.183438:0:22750:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183481:0:22750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683804.183486:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+4:22782:x1876618850329216:12345-0@lo:104: Request processed in 62us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683804.183493:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683804.183508:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683804.183514:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7258c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+3:22782:x1876618850329344:12345-0@lo:104: 00010000:00010000:1.0:1789683804.183521:0:22750:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183554:0:22750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789683804.183558:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7258c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+3:22782:x1876618850329344:12345-0@lo:104: Request processed in 45us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683804.183564:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683804.183612:0:22782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850329216:0@lo:104: 00000100:00100000:1.0:1789683804.183620:0:22782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850329344:0@lo:104: 00010000:00010000:1.0:1789683804.183634:0:22782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183660:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683804.183666:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183672:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8a00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683804.183676:0:23923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183684:0:23923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683804.183692:0:23923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683804.183697:0:23923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789683804.183736:0:23923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183742:0:23923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683804.183761:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183767:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88b23d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b244 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183778:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683804.183803:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183820:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9800 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683804.183823:0:23923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183830:0:23923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683804.183836:0:23923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683804.183842:0:23923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789683804.183854:0:23923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183859:0:23923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683804.183875:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183881:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b88b22f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b236 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.183894:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683804.183896:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683804.183898:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683804.183904:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683804.183922:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850329472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683804.183952:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.183983:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850329600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683804.184015:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683804.184051:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850329472 00000100:00100000:1.0:1789683804.184056:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850329472 00010000:00010000:1.0:1789683804.184072:0:22753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88b244 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b23d expref: 21 pid: 22759 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683804.184089:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850329600 00000100:00100000:1.0:1789683804.184092:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850329600 00010000:00010000:1.0:1789683804.184102:0:22753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b22f expref: 22 pid: 22760 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683804.184114:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683804.184119:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acf86134-5469-4898-92a9-e106d5944cd1+22:3648:x1876618850329472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683804.184129:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683804.184134:0:22753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88b244 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b23d expref: 22 pid: 22759 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184144:0:22753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88b244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b23d expref: 22 pid: 22759 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184157:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88b244 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b23d expref: 22 pid: 22759 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184169:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683804.184197:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acf86134-5469-4898-92a9-e106d5944cd1+21:3648:x1876618850329472:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683804.184203:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683804.184216:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683804.184222:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acf86134-5469-4898-92a9-e106d5944cd1+20:3649:x1876618850329600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683804.184238:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683804.184242:0:22753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b22f expref: 20 pid: 22760 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184252:0:22753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b22f expref: 20 pid: 22760 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184260:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b22f expref: 20 pid: 22760 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184272:0:22753:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184279:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789683804.184292:0:22753:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005358220s 00010000:00010000:1.0:1789683804.184296:0:22753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184302:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184309:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184315:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184319:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683804.184323:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184334:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184348:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184356:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683804.184383:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acf86134-5469-4898-92a9-e106d5944cd1+19:3649:x1876618850329600:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683804.184389:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683804.184439:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850329472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683804.184455:0:22782:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184462:0:22782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683804.184468:0:22782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b2ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683804.184489:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850329600:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1789683804.194106:0:24272:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1789683804.202479:0:24272:0:(ofd_obd.c:547:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789683804.202489:0:24272:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789683804.202543:0:24272:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789683804.202597:0:24272:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789683804.202613:0:24272:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789683804.202634:0:24272:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789683804.209603:0:24272:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683804.209895:0:24272:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789683804.319148:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789683805.237621:0:24351:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789683805.238416:0:24351:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789683805.285148:0:22763:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789683805.285167:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fa7d90800 from 13 10000000:01000000:0.0:1789683805.285172:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789683805.285225:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683805.285267:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683805.285280:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683805.285307:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850329728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683805.285382:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683805.285424:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e835a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789683805.286199:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850329728 00000100:00100000:2.0:1789683805.286209:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850329728 00000100:00100000:2.0:1789683805.286276:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683805.286285:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+19:22763:x1876618850329728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683805.286300:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683805.286316:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b2fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b2f3 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683805.286339:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b2f3 expref: 20 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683805.286351:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b2f3 expref: 20 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683805.286359:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31400, rc 0) 00000100:00100000:2.0:1789683805.286412:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+20:22763:x1876618850329728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683805.286430:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683805.286626:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850329728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683805.286642:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683805.286652:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683805.286736:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850329856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789683805.286769:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683805.286815:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88afbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683805.286829:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850329856 00000100:00100000:2.0:1789683805.286833:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850329856 00000100:00100000:2.0:1789683805.286854:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683805.286860:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+20:22763:x1876618850329856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789683805.286873:0:22759:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789683805.286889:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789683805.286892:0:22759:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1789683805.289075:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+20:22763:x1876618850329856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683805.289096:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683805.292748:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850329856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789683805.292865:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789683805.292878:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683805.292906:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683805.292917:0:22763:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789683805.292919:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fc06b2000 from 13 10000000:01000000:2.0:1789683805.292922:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789683805.292971:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683805.292980:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683805.293000:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683805.293024:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850329984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683805.293091:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683805.293143:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f830b5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683805.294412:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850329984 00000100:00100000:1.0:1789683805.294425:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850329984 00000100:00100000:1.0:1789683805.294496:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789683805.294507:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+20:22763:x1876618850329984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683805.294523:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683805.294541:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b301 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683805.294572:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b301 expref: 21 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683805.294585:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b301 expref: 21 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683805.294596:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8000, rc 0) 00000100:00100000:1.0:1789683805.294665:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+21:22763:x1876618850329984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683805.294672:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789683805.300845:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850329984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683805.300875:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683805.300889:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683805.300963:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850330112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789683805.301032:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683805.301084:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f830b5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683805.301750:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850330112 00000100:00100000:0.0:1789683805.301762:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850330112 00000100:00100000:0.0:1789683805.301849:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789683805.301860:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:22763:x1876618850330112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789683805.301885:0:22761:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683805.301905:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683805.301908:0:22761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789683805.302031:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:22763:x1876618850330112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 173us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683805.302040:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789683805.306322:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850330112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789683805.306422:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789683805.306433:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683805.306445:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683805.348843:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683806.367294:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683807.390958:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683807.841759:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683807.841802:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850330240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683807.841881:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683807.841945:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850330240 00000100:00100000:1.0:1789683807.841953:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850330240 00000100:00100000:1.0:1789683807.842002:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789683807.842011:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850330240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683807.842043:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789683807.842103:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850330240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683807.842483:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789683807.842541:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850330240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683807.847187:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683807.847208:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850330368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683807.847284:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683807.847957:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850330368 00000100:00100000:3.0:1789683807.847966:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850330368 00000100:00100000:3.0:1789683807.848011:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683807.848020:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850330368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789683807.848052:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789683807.848101:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850330368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683807.848223:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789683807.850446:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850330368:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789683808.415193:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789683809.380914:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683809.380920:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683809.380928:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683809.380931:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683809.380951:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683809.380954:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683809.380957:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683809.380960:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789683809.384760:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850330496:0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.384976:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683809.385028:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850331008:0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.385052:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683809.385080:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683809.385087:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850330880:0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.385110:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683809.385136:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850330752:0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.385156:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683809.385171:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850331264:0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.385280:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683809.385301:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789683809.385308:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850330624:0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.385329:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683809.385344:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850331136:0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.385365:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683809.385393:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850331008 00000100:00100000:3.0:1789683809.385402:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850331008 00000100:00100000:3.0:1789683809.385438:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850330752 00000100:00100000:3.0:1789683809.385441:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850330752 00000100:00100000:3.0:1789683809.385453:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850331264 00000100:00100000:3.0:1789683809.385455:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850331264 00000100:00100000:3.0:1789683809.385472:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850331136 00000100:00100000:3.0:1789683809.385474:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850331136 00000100:00100000:3.0:1789683809.385489:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683809.385496:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850331008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.385547:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850331008:12345-0@lo:400:kworker.0 Request processed in 51us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683809.385554:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683809.385569:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683809.385574:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850330752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.385602:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850330752:12345-0@lo:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683809.385607:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683809.385618:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789683809.385636:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850331264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.385661:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850331264:12345-0@lo:400:kworker.0 Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683809.385673:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789683809.385685:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789683809.385691:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850331136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.385717:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850331136:12345-0@lo:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683809.385885:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850330496 00000100:00100000:0.0:1789683809.385890:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850330496 00000100:00100000:0.0:1789683809.385920:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789683809.385927:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+21:3648:x1876618850330496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683809.385959:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+21:3648:x1876618850330496:12345-0@lo:400:kworker.0 Request processed in 33us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683809.385966:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1789683809.386001:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683809.386006:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683809.386062:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789683809.386088:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850330880 00000100:00100000:3.0:1789683809.386092:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850330880 00000100:00100000:3.0:1789683809.386154:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850330624 00000100:00100000:3.0:1789683809.386157:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850330624 00000100:00100000:0.0:1789683809.386497:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789683809.386506:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850330880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683809.386545:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850330880:12345-0@lo:400:kworker.0 Request processed in 40us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683809.386550:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789683809.386563:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789683809.386569:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850330624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683809.386595:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850330624:12345-0@lo:400:kworker.0 Request processed in 26us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683809.386611:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683809.387014:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850330624:0@lo:400:kworker.0 00010000:00080000:3.0:1789683809.387028:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fa7de1500 x1876618850331136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683809.387039:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850331136:0@lo:400:kworker.0 00010000:00080000:3.0:1789683809.387049:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fa7de3800 x1876618850330752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683809.387057:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850330752:0@lo:400:kworker.0 00010000:00080000:3.0:1789683809.387067:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb61f1c00 x1876618850331264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683809.387075:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850331264:0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.387114:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850330880:0@lo:400:kworker.0 00000100:00100000:3.0:1789683809.387123:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850330496:0@lo:400:kworker.0 00010000:00080000:3.0:1789683809.387134:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fa7de2a00 x1876618850331008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683809.387149:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850331008:0@lo:400:kworker.0 00010000:00010000:3.0:1789683809.439062:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789683809.762150:0:23519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789683810.465957:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789683810.828679:0:24642:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789683811.487319:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789683811.922381:0:24694:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683811.922628:0:24694:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1789683812.194554:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789683812.384717:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683797/real 1789683797] req@ffff9f0e83ead880 x1876618850323968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683812 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683812.384751:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0e83ead880 x1876618850323968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683812 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683812.384762:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683797/real 1789683797] req@ffff9f0e83ead500 x1876618850324096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683812 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683812.384774:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0e83ead500 x1876618850324096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683812 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789683812.384967:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdba000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683812.385046:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789683812.385050:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850323968:0@lo:8:kworker.0 00000100:00080000:3.0:1789683812.385056:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5185800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683812.385880:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683812.385885:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683812.385888:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683812.385891:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683812.385919:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683812.385923:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789683812.385925:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdba000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683812.385931:0:499:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 711 00000100:00080000:2.0:1789683812.385939:0:499:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789683812.385950:0:499:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0f8bdba000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683812.385970:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83db5f80 x1876618850331904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683812.385982:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683812.385985:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789683812.385987:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5185800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683812.385990:0:499:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 711 00000100:00080000:2.0:1789683812.385999:0:499:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789683812.386005:0:499:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0fb5185800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683812.386017:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83db4a80 x1876618850332032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683812.386170:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850331392:0@lo:400:kworker.0 00000100:00100000:1.0:1789683812.386252:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683812.386299:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683812.386306:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850331520:0@lo:400:kworker.0 00000100:00100000:1.0:1789683812.386349:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683812.386377:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850331648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683812.386404:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683812.386423:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683812.386427:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850331776:0@lo:400:kworker.0 00000100:00100000:1.0:1789683812.386446:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683812.386474:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850331392 00000100:00100000:1.0:1789683812.386481:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850331392 00000100:00100000:1.0:1789683812.386532:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789683812.386543:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+21:3647:x1876618850331392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683812.386616:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+21:3647:x1876618850331392:12345-0@lo:400:kworker.0 Request processed in 74us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683812.386623:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789683812.386659:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850331520 00000100:00100000:1.0:1789683812.386663:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850331520 00000100:00100000:1.0:1789683812.386696:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850331776 00000100:00100000:1.0:1789683812.386700:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850331776 00000100:00100000:1.0:1789683812.386712:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683812.386717:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850331520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683812.386753:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850331520:12345-0@lo:400:kworker.0 Request processed in 35us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683812.386759:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683812.386771:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683812.386776:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850331776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683812.386837:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850331776:12345-0@lo:400:kworker.0 Request processed in 60us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683812.386843:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683812.386860:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850331648 00000100:00100000:1.0:1789683812.386864:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850331648 00000100:00100000:1.0:1789683812.386887:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683812.386894:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850331648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683812.386922:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850331648:12345-0@lo:400:kworker.0 Request processed in 29us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683812.386929:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683812.386971:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850331776:0@lo:400:kworker.0 00010000:00080000:1.0:1789683812.386982:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83db7480 x1876618850331648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683812.386990:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850331648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683812.387015:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850331520:0@lo:400:kworker.0 00000100:00100000:1.0:1789683812.387022:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850331392:0@lo:400:kworker.0 00000100:00100000:2.0:1789683812.387492:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850332288:0@lo:400:kworker.0 00000100:00100000:2.0:1789683812.387526:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683812.387548:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683812.387553:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850332160:0@lo:400:kworker.0 00000100:00100000:2.0:1789683812.387584:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683812.387603:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683812.387611:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850332416:0@lo:400:kworker.0 00000100:00100000:2.0:1789683812.387633:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683812.387659:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850332288 00000100:00100000:2.0:1789683812.387663:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850332288 00000100:00100000:2.0:1789683812.387695:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850332160 00000100:00100000:2.0:1789683812.387698:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850332160 00000100:00100000:2.0:1789683812.387709:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850332416 00000100:00100000:2.0:1789683812.387711:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850332416 00000100:00100000:2.0:1789683812.387724:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789683812.387730:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850332288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683812.387765:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850332288:12345-0@lo:400:kworker.0 Request processed in 35us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683812.387771:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789683812.387986:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789683812.387994:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850332160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683812.388024:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850332160:12345-0@lo:400:kworker.0 Request processed in 31us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683812.388053:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789683812.388066:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789683812.388071:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850332416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683812.388103:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850332416:12345-0@lo:400:kworker.0 Request processed in 32us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683812.388109:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789683812.388125:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683812.388128:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789683812.388146:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83db7480 x1876618850332416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683812.388159:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850332416:0@lo:400:kworker.0 00010000:00080000:2.0:1789683812.388181:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83db4380 x1876618850332160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683812.388203:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850332160:0@lo:400:kworker.0 00010000:00080000:2.0:1789683812.388214:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83db5500 x1876618850332288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683812.388222:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850332288:0@lo:400:kworker.0 00000100:00080000:3.0:1789683812.388585:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789683812.388591:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850324096:0@lo:8:kworker.0 00000100:00100000:3.0:1789683812.388614:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850331904:0@lo:8:kworker.0 00000100:00100000:3.0:1789683812.388654:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683812.388725:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850332032:0@lo:8:kworker.0 00000100:00100000:3.0:1789683812.388752:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789683812.388819:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683812.388825:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683812.388828:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683812.388831:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789683812.389166:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850331904 00000100:00100000:1.0:1789683812.389173:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850331904 00000100:00100000:1.0:1789683812.389209:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850332032 00000100:00100000:1.0:1789683812.389212:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850332032 00000100:00100000:1.0:1789683812.389222:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683812.389228:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1876618850331904:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789683812.389253:0:24277:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:1.0:1789683812.389282:0:24277:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88b30f 00002000:00100000:1.0:1789683812.389296:0:24277:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9f0e82d9c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789683812.389300:0:24277:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789683812.389302:0:24277:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789683812.389477:0:24277:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789683812.389504:0:24277:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d9e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683812.389563:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1876618850331904:12345-0@lo:8:kworker.0 Request processed in 334us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683812.389582:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683812.389599:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683812.389604:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1876618850332032:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789683812.389617:0:24277:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789683812.390106:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83db5f80 x1876618850331904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683812.390118:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683812.390127:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789683812.390137:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789683812.390143:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789683812.390145:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdba000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789683812.390156:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789683812.390162:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850331904:0@lo:8:kworker.0 00000004:00080000:3.0:1789683812.391213:0:23510:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789683812.391225:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850332544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683812.391247:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23510:1876618850332672:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789683812.391280:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683812.391280:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683812.391303:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456fc00 going to sleep for 11 seconds 00000004:00080000:3.0:1789683812.391328:0:23509:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789683812.391400:0:23509:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 726440615142ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789683812.391404:0:23509:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789683812.391435:0:24279:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789683812.391442:0:24279:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789683812.391687:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850332672 00000100:00100000:3.0:1789683812.391694:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850332672 00000100:00100000:3.0:1789683812.391833:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683812.391842:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23510:x1876618850332672:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789683812.392446:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850332544 00000100:00100000:2.0:1789683812.392458:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850332544 00000100:00100000:2.0:1789683812.392496:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683812.392503:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1876618850332544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683812.392522:0:24280:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683812.392591:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1876618850332544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683812.392598:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789683812.392620:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683812.393893:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fa7de0000 x1876618850332544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683812.393919:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850332544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683812.400732:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1876618850332032:12345-0@lo:8:kworker.0 Request processed in 11120us (11972us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789683812.400747:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:3.0:1789683812.402102:0:24715:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789683812.402110:0:24715:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1789683812.402185:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23510:x1876618850332672:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10342us (10903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683812.402195:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789683812.402306:0:23510:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fa7de1f80 x1876618850332672/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789683828 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683812.402323:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23510:1876618850332672:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1789683812.402350:0:23510:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789683812.402396:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23510:1876618850332800:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789683812.402436:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683812.402466:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683812.402515:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850332800 00000100:00100000:3.0:1789683812.402523:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850332800 00000100:00100000:3.0:1789683812.402564:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683812.402584:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23510:x1876618850332800:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789683812.402610:0:24279:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1789683812.402739:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23510:x1876618850332800:12345-0@lo:5:osp-pre-0-1.0 Request processed in 158us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683812.402746:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789683812.405541:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5185800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683812.405555:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789683812.405561:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850332032:0@lo:8:kworker.0 00000004:00080000:0.0:1789683812.409058:0:23501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:1.0:1789683812.410684:0:23510:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eadf80 x1876618850332800/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683828 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683812.410706:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23510:1876618850332800:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789683812.410723:0:23510:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789683812.410779:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23510:1876618850332928:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789683812.410868:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683812.410903:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683812.415150:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850332928 00000100:00100000:3.0:1789683812.415167:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850332928 00000100:00100000:3.0:1789683812.416288:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683812.416304:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23510:x1876618850332928:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789683812.416358:0:24277:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1789683812.437812:0:24273:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1789683812.437830:0:24273:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789683812.438049:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23510:x1876618850332928:12345-0@lo:5:osp-pre-0-1.0 Request processed in 21746us (27177us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789683812.438060:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789683812.438148:0:23510:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eadf80 x1876618850332928/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683828 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683812.438161:0:23510:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1789683812.438167:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23510:1876618850332928:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789683812.438183:0:23510:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1789683812.438236:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23510:1876618850333056:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789683812.438277:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683812.438310:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683812.438377:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850333056 00000100:00100000:3.0:1789683812.438386:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850333056 00000100:00100000:3.0:1789683812.438438:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683812.438446:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23510:x1876618850333056:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789683812.438511:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23510:x1876618850333056:12345-0@lo:900:osp-pre-0-1.0 Request processed in 66us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683812.438518:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789683812.438705:0:23510:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eadf80 x1876618850333056/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789683828 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683812.438728:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23510:1876618850333056:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789683812.511135:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789683812.835694:0:24745:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789683812.836140:0:24745:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789683812.958936:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850333184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683812.959022:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683812.962571:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850333312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683812.962664:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683812.962853:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850333184 00000100:00100000:1.0:1789683812.962861:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850333184 00000100:00100000:1.0:1789683812.962914:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850333312 00000100:00100000:1.0:1789683812.962917:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850333312 00000100:00100000:1.0:1789683812.962932:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789683812.962941:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850333184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683812.962979:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789683812.963027:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850333184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (4009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683812.963033:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789683812.963052:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789683812.963058:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850333312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683812.963073:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683812.963106:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850333312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683812.963112:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789683812.963152:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850333312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683812.963302:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850333184:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789683813.535453:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683814.559190:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683815.454965:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683795/real 1789683795] req@ffff9f0fc1c69c00 x1876618850322304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683815 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683815.455077:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fc1c69c00 x1876618850322304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683815 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683815.455089:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683795/real 1789683795] req@ffff9f0fc1c6a300 x1876618850322432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683815 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683815.455101:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fc1c6a300 x1876618850322432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683815 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683815.455132:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0500000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683815.455157:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789683815.455167:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850322304:0@lo:8:kworker.0 00000100:00080000:0.0:1789683815.455174:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c34000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683815.455180:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789683815.455182:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850322432:0@lo:8:kworker.0 00000100:00100000:2.0:1789683815.455641:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850333440:0@lo:400:kworker.0 00000100:00100000:2.0:1789683815.455719:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683815.455869:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850333568:0@lo:400:kworker.0 00000100:00100000:3.0:1789683815.455904:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683815.455947:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850333568 00000100:00100000:3.0:1789683815.455956:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850333568 00000100:00100000:0.0:1789683815.456209:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850333440 00000100:00100000:0.0:1789683815.456214:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850333440 00000100:00100000:0.0:1789683815.456255:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789683815.456264:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:3649:x1876618850333440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683815.456400:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789683815.456408:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850333568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683815.456450:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850333568:12345-0@lo:400:kworker.0 Request processed in 44us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683815.456457:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789683815.456494:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850333568:0@lo:400:kworker.0 00000100:00080000:1.0:1789683815.456737:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683815.456742:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789683815.456745:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0500000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683815.456749:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 709 00000100:00080000:1.0:1789683815.456753:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789683815.456760:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0fc0500000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683815.456930:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:3649:x1876618850333440:12345-0@lo:400:kworker.0 Request processed in 665us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683815.456937:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789683815.457088:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83ead500 x1876618850333696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683815.457110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683815.457113:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683815.457115:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c34000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683815.457119:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 709 00000100:00080000:1.0:1789683815.457121:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789683815.457127:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0e83c34000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683815.457139:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83ead880 x1876618850333824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683815.457184:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683815.457187:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683815.457188:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5185800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683815.457191:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 726 00000100:00080000:1.0:1789683815.457193:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789683815.457207:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0fb5185800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683815.457217:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83eadf80 x1876618850334336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683815.457253:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850334080:0@lo:400:kworker.0 00000100:00100000:1.0:1789683815.457284:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683815.457301:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850334720:0@lo:400:kworker.0 00000100:00100000:1.0:1789683815.457319:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683815.457336:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789683815.457341:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850333952:0@lo:400:kworker.0 00000100:00100000:1.0:1789683815.457368:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683815.457382:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850334592:0@lo:400:kworker.0 00000100:00100000:1.0:1789683815.457402:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683815.457423:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850334720 00000100:00100000:1.0:1789683815.457427:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850334720 00000100:00100000:1.0:1789683815.457459:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850333952 00000100:00100000:1.0:1789683815.457462:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850333952 00000100:00100000:1.0:1789683815.457472:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850334592 00000100:00100000:1.0:1789683815.457475:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850334592 00000100:00100000:1.0:1789683815.457487:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789683815.457493:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850334720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683815.457543:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850334720:12345-0@lo:400:kworker.0 Request processed in 50us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683815.457550:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789683815.457564:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789683815.457569:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850333952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683815.457596:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850333952:12345-0@lo:400:kworker.0 Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683815.457602:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789683815.457612:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789683815.457618:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850334592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683815.457646:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850334592:12345-0@lo:400:kworker.0 Request processed in 29us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683815.457651:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789683815.457678:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eae300 x1876618850333952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683815.457700:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850333952:0@lo:400:kworker.0 00010000:00080000:1.0:1789683815.457712:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc1c69c00 x1876618850334592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683815.457720:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850334592:0@lo:400:kworker.0 00010000:00080000:1.0:1789683815.457728:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc1c68700 x1876618850334720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683815.457735:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850334720:0@lo:400:kworker.0 00000100:00100000:3.0:1789683815.458107:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850334080 00000100:00100000:3.0:1789683815.458112:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850334080 00000100:00100000:3.0:1789683815.458140:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789683815.458147:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850334080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683815.458216:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850334080:12345-0@lo:400:kworker.0 Request processed in 69us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683815.458223:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789683815.458251:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850334080:0@lo:400:kworker.0 00000100:00100000:3.0:1789683815.458269:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850334464:0@lo:400:kworker.0 00000100:00100000:3.0:1789683815.458295:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683815.458315:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683815.458321:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850334208:0@lo:400:kworker.0 00000100:00100000:3.0:1789683815.458344:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683815.458369:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850334464 00000100:00100000:3.0:1789683815.458373:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850334464 00000100:00100000:3.0:1789683815.458397:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789683815.458402:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850334464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683815.458432:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850334464:12345-0@lo:400:kworker.0 Request processed in 30us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683815.458438:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789683815.458468:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc1c6a300 x1876618850334464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683815.458477:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850334464:0@lo:400:kworker.0 00000100:00100000:0.0:1789683815.458675:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850333696:0@lo:8:kworker.0 00000100:00100000:0.0:1789683815.458710:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683815.458756:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850333824:0@lo:8:kworker.0 00000100:00100000:0.0:1789683815.458816:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683815.458840:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850334336:0@lo:8:kworker.0 00000100:00100000:0.0:1789683815.458861:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683815.458896:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850334208 00000100:00100000:0.0:1789683815.458900:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850334208 00000100:00100000:0.0:1789683815.458923:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850333696 00000100:00100000:0.0:1789683815.458925:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850333696 00000100:00100000:0.0:1789683815.458935:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850333824 00000100:00100000:0.0:1789683815.458937:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850333824 00000100:00100000:0.0:1789683815.458943:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850334336 00000100:00100000:0.0:1789683815.458944:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850334336 00000100:00100000:0.0:1789683815.458953:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683815.458960:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850334208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683815.459006:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850334208:12345-0@lo:400:kworker.0 Request processed in 47us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683815.459011:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683815.459023:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683815.459027:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1876618850333696:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789683815.459053:0:24715:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:0.0:1789683815.459087:0:24715:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88b316 00002000:00100000:0.0:1789683815.459101:0:24715:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f0e825e6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789683815.459106:0:24715:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789683815.459108:0:24715:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789683815.459210:0:24715:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789683815.459232:0:24715:0:(import.c:65:import_set_state_nolock()) ffff9f0e825e1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683815.459270:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876618850333696:12345-0@lo:8:kworker.0 Request processed in 241us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683815.459283:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683815.459296:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683815.459300:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1876618850333824:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789683815.459313:0:24715:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789683815.459339:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1876618850333824:12345-0@lo:8:kworker.0 Request processed in 38us (556us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789683815.459345:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683815.459354:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789683815.459358:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1876618850334336:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789683815.459368:0:24715:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789683815.459391:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1876618850334336:12345-0@lo:8:kworker.0 Request processed in 32us (529us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789683815.459397:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789683815.459426:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83ead500 x1876618850333696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683815.459434:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683815.459440:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789683815.459448:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789683815.459453:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789683815.459455:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0500000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789683815.459467:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789683815.459472:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850333696:0@lo:8:kworker.0 00000100:00080000:0.0:1789683815.459482:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c34000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683815.459487:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789683815.459495:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850333824:0@lo:8:kworker.0 00000100:00080000:0.0:1789683815.459508:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5185800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683815.459521:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789683815.459524:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850334336:0@lo:8:kworker.0 00000004:00080000:0.0:1789683815.459568:0:22791:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1789683815.459584:0:22791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22791:1876618850334976:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789683815.459608:0:22791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683815.459624:0:22791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f82bd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789683815.459636:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850334976 00000100:00100000:0.0:1789683815.459640:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850334976 00000100:00100000:0.0:1789683815.459660:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789683815.459665:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22791:x1876618850334976:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789683815.460462:0:22790:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789683815.460556:0:22790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729509771255ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789683815.460574:0:22790:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:3.0:1789683815.460628:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83ead180 x1876618850334208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683815.460639:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850334208:0@lo:400:kworker.0 00000100:00100000:3.0:1789683815.460655:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683815.460662:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850334848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683815.460699:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683815.460738:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850334848 00000100:00100000:3.0:1789683815.460743:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850334848 00000100:00100000:3.0:1789683815.460775:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683815.460914:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876618850334848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683815.460936:0:24280:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789683815.460977:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876618850334848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683815.460984:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789683815.461012:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb61f0700 x1876618850334848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683815.461026:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850334848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683815.464103:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850333440:0@lo:400:kworker.0 00000100:00080000:2.0:1789683815.464141:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683815.464147:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683815.464150:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00080000:3.0:1789683815.465762:0:24715:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789683815.465775:0:24715:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1789683815.465780:0:24715:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000004:00080000:1.0:1789683815.472121:0:22746:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789683815.489645:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.489658:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b31d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.489675:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.489696:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.489703:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.489722:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.489733:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.489741:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b31d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.489767:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683815.490081:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.490089:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b31d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.490098:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.490102:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b31d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.490122:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b31d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.490142:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b31d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.490150:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b31d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.490205:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.490208:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.490210:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.490272:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.490278:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b324 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.490288:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.490291:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.490295:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.490304:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.490311:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.490324:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.490347:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683815.492314:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.492326:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.492340:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.492345:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.492356:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b324 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.492376:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b324 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.492384:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b324 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.492406:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.492408:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.492410:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789683815.492722:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683815.492730:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e004000/0xcf8485587b88b32b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.492753:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789683815.492758:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683815.492763:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e004000/0xcf8485587b88b32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.492776:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e004000/0xcf8485587b88b32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.492886:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e004000/0xcf8485587b88b32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.492895:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e004000/0xcf8485587b88b32b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.492924:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683815.493908:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683815.493917:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e004000/0xcf8485587b88b32b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.493927:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683815.493932:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e004000/0xcf8485587b88b32b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.493940:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e004000/0xcf8485587b88b32b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.493958:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e004000/0xcf8485587b88b32b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.493966:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e004000/0xcf8485587b88b32b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.493987:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683815.493989:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683815.493991:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789683815.496372:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683815.496385:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88b332 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.496401:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789683815.496406:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683815.496412:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88b332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.496425:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88b332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.496451:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88b332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.496459:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88b332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.496486:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683815.497294:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683815.497309:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88b332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.497318:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683815.497323:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88b332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.497333:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88b332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.497351:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88b332 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.497359:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88b332 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.497382:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683815.497384:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683815.497386:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789683815.497609:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683815.497616:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88b339 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.497625:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789683815.497628:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683815.497633:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88b339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.497644:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88b339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.497652:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88b339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.497660:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88b339 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.497736:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683815.499499:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.499521:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b340 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.499535:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.499539:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.499545:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.499575:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.499585:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.499592:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.503657:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683815.503670:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88b339 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.503685:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683815.503690:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88b339 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.503700:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88b339 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.503730:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88b339 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.503757:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88b339 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.503931:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683815.503964:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683815.503969:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.503977:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683815.503979:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.503987:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b340 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.503998:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b340 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.504004:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b340 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.504899:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.506592:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.506606:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b347 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.506622:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.506627:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.506632:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.506646:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.506656:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.506677:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b347 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.506706:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683815.507055:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.507063:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b347 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.507073:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.507078:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b347 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.507088:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b347 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.507105:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b347 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.507113:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b347 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.507132:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.507134:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.507135:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.508141:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.508149:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b34e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.508173:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.508177:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.508181:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.508192:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.508200:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.508208:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b34e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.508231:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683815.508565:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.508573:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b34e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.508581:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.508592:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b34e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.508603:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b34e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.508617:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b34e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.508624:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b34e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.508644:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.508646:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.508647:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.509918:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.509928:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b355 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.509945:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.509949:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.509953:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.509965:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.510033:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.510042:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.510061:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683815.510600:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.510608:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.510617:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.510621:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.510630:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b355 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.510645:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b355 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.510659:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b355 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.510680:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.510682:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.510683:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.510925:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.510932:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b35c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.510940:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.510943:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.510947:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.510957:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.511069:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683815.511127:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.511136:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b35c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.511158:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683815.511242:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.511247:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b35c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.511255:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.511258:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b35c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.511266:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b35c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.511277:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b35c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.511284:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.511285:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.511287:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683815.511312:0:24715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b35c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.511618:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.512116:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.512123:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b363 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.512133:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.512136:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.512140:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.512149:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.512157:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.512549:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.512572:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683815.513126:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.513133:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.513156:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3a00 already unused, calling callback (ffffffffc0b9a8b0) 00002000:00010000:3.0:1789683815.513327:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.513334:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b36a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.513344:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.513348:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.513353:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.513363:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.513371:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.513379:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b36a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.513408:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683815.513646:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.513661:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.513679:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b363 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.513686:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b363 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.513704:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.513707:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b36a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.513714:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.513717:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b36a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.513724:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b36a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.513733:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b36a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.513748:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b36a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.513761:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.513763:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.513765:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.513907:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.515075:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.515086:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b371 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.515106:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.515110:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.515114:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.515127:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.515136:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.515144:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.517040:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683815.520297:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.520312:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b378 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.520329:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.520334:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.520340:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.520354:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.520387:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.520394:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.528142:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683815.528157:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.528196:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683815.528201:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.528213:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b371 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.528235:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b371 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.528242:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b371 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.530557:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683815.532278:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683815.532291:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.532303:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683815.532307:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.532317:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b378 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.532339:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b378 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.532355:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b378 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.532381:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.532384:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.532385:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.532684:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.532688:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.532690:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.540489:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.540505:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b37f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.540534:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.540539:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.540545:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.540559:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.540570:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.540579:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b37f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.540651:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683815.542654:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.542666:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b386 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.542681:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.542686:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.542692:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.542704:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.542714:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.542722:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b386 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.543412:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683815.543420:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b37f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.543429:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683815.543433:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b37f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.543443:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b37f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.543462:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b37f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.543469:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b37f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.543486:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683815.543489:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b386 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.543505:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683815.543509:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b386 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.543528:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b386 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.543538:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b386 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.543545:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.543546:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.543548:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683815.550669:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789683815.550686:0:24715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b386 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683815.552608:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.552622:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b38d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.552647:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.552652:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.552660:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.552675:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.552687:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.552695:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b38d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.552712:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683815.554318:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.554332:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b38d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.554350:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.554356:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b38d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.554366:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b38d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.554388:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b38d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.554395:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b38d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.554432:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.554434:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.554436:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.554447:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.555359:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.555370:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b394 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.555384:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.555389:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.555395:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.555408:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.555431:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.555440:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.555466:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683815.556541:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.556551:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.556563:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.556568:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.556579:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b394 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.556597:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b394 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.556605:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1ecd51f/0xcf8485587b88b394 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.556627:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.556629:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.556631:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789683815.557403:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683815.557411:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b39b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.557432:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789683815.557437:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683815.557442:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.557454:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.557464:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.557472:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b39b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.557498:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683815.558366:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.558375:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b3a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.558387:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.558391:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.558395:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.558405:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.558412:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.558419:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.558453:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789683815.558728:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683815.558736:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b39b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.558745:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.558750:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b39b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.558758:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b39b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.558879:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b39b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.558888:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b39b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.558906:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.558910:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.558916:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.558919:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.558926:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b3a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.558936:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b3a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.558942:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cb99b03/0xcf8485587b88b3a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.558956:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.558957:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.558966:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.559072:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.560359:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.560370:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b3a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.560384:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.560388:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.560393:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.560405:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.560414:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.560421:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b3a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.560474:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683815.563269:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.563285:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b3b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.563301:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.563312:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.563319:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.563333:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.563345:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.563352:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b3b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.567453:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683815.567469:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b3a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.567484:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683815.567489:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b3a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.567500:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b3a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.567533:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b3a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.567548:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b01432b5/0xcf8485587b88b3a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.567651:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683815.567655:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b3b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.567662:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683815.567666:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b3b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.567674:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b3b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.567684:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b3b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.567692:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.567694:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.567695:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683815.567958:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789683815.567968:0:24715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c10ac4f1/0xcf8485587b88b3b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.569712:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.570271:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.570282:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b3b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.570297:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.570301:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.570307:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.570321:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.570339:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.570346:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b3b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.570367:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683815.571042:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683815.571050:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b3b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.571060:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683815.571074:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b3b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.571083:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b3b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.571099:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b3b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.571105:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8574275/0xcf8485587b88b3b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.571126:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.571128:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.571130:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.573559:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.573574:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b3be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.573591:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.573595:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.573601:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.573614:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.573625:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.573632:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.573672:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683815.574921:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.574931:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.574943:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.574947:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.574957:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b3be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.574980:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b3be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.574988:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aedfd3f9/0xcf8485587b88b3be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.575007:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.575009:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.575010:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.576408:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.576419:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b3c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.576435:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.576439:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.576445:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.576457:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.576467:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.576475:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.576497:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683815.576727:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683815.576734:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.576743:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc3600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683815.576747:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.576756:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.576886:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b3c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.576895:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004f29898/0xcf8485587b88b3c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.576916:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683815.576918:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683815.576920:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683815.578125:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683815.578136:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b3cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.578150:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789683815.578461:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683815.578471:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.578484:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.578493:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683815.578500:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b3cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.580355:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789683815.581063:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683815.581071:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b3d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581086:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789683815.581090:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683815.581103:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581117:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581127:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581136:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b3d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581154:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789683815.581284:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683815.581292:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b3cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581300:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.581305:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b3cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581315:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b3cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581332:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b3cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581351:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e940a47/0xcf8485587b88b3cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581375:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683815.581378:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b3d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581385:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683815.581389:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b3d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581396:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b3d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581407:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b3d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581414:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000887b3c5d/0xcf8485587b88b3d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.581426:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.581428:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.581430:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683815.582907:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789683815.584105:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683815.584118:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88b3da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.584148:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789683815.584153:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683815.584171:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88b3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.584188:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88b3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.584199:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88b3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.584207:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88b3da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.584227:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683815.585294:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683815.585304:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88b3da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.585316:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683815.585322:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88b3da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.585331:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88b3da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.585350:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88b3da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.585358:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88b3da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.585389:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683815.585391:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683815.585393:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789683815.586063:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683815.586072:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cef1f3ff/0xcf8485587b88b3e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.586086:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789683815.586090:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683815.586096:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cef1f3ff/0xcf8485587b88b3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.586110:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cef1f3ff/0xcf8485587b88b3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.586130:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cef1f3ff/0xcf8485587b88b3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.586138:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cef1f3ff/0xcf8485587b88b3e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.586287:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789683815.586683:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683815.586690:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88b3e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.586699:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789683815.586702:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683815.586707:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88b3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.586717:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88b3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.586724:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88b3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.586731:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88b3e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.586765:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789683815.586913:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683815.586919:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cef1f3ff/0xcf8485587b88b3e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.586928:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683815.586932:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cef1f3ff/0xcf8485587b88b3e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.586941:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cef1f3ff/0xcf8485587b88b3e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.586955:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cef1f3ff/0xcf8485587b88b3e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.586962:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cef1f3ff/0xcf8485587b88b3e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.587038:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683815.587044:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88b3e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.587050:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683815.587059:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88b3e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.587067:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88b3e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.587077:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88b3e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.587084:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88b3e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.587097:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683815.587098:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683815.587099:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683815.588331:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789683815.588443:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683815.588451:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb82b8/0xcf8485587b88b3ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.588464:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789683815.588468:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683815.588474:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb82b8/0xcf8485587b88b3ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.588486:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2fb82b8/0xcf8485587b88b3ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.588495:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb82b8/0xcf8485587b88b3ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.588503:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb82b8/0xcf8485587b88b3ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683815.589345:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683815.597322:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683815.597337:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2fb82b8/0xcf8485587b88b3ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.597352:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683815.597357:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fb82b8/0xcf8485587b88b3ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.597370:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fb82b8/0xcf8485587b88b3ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.597395:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2fb82b8/0xcf8485587b88b3ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.597413:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2fb82b8/0xcf8485587b88b3ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683815.597433:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683815.597435:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683815.597437:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683815.602029:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789683815.603537:0:24715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789683815.603548:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88b3f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.603566:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=729s v=(0 0) 00010000:00010000:0.0:1789683815.603571:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683815.603577:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88b3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.603592:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88b3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.603602:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88b3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.603618:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88b3f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.603642:0:24715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789683815.604020:0:24715:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1789683815.604129:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22791:x1876618850334976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 144459us (144516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683815.604139:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683815.608607:0:22791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22791:1876618850334976:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789683815.608634:0:22791:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1789683815.608702:0:22791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22791:1876618850335104:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789683815.608827:0:22791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683815.608861:0:22791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683815.608884:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850335104 00000100:00100000:1.0:1789683815.608891:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850335104 00000100:00100000:1.0:1789683815.608946:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789683815.608955:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22791:x1876618850335104:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789683815.609137:0:24279:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:0.0:1789683815.614143:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683815.614171:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88b3f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.614186:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ca00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683815.614190:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88b3f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.614211:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88b3f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.614236:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88b3f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.614244:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88b3f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683815.614284:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.614285:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683815.614287:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789683815.629207:0:24273:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1789683815.629256:0:24273:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789683815.632575:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22791:x1876618850335104:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23605us (23732us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789683815.632589:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683815.632712:0:22791:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1789683815.632723:0:22791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22791:1876618850335104:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789683815.632743:0:22791:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:1.0:1789683816.607061:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683817.578716:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683817.578746:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850335232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683817.578844:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683817.579808:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850335232 00000100:00100000:0.0:1789683817.579817:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850335232 00000100:00100000:0.0:1789683817.579876:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683817.579885:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850335232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683817.579921:0:24280:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789683817.579994:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850335232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683817.580001:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683817.580335:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850335232:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789683817.580414:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789683817.631242:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683818.080165:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850335360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683818.080241:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683818.080326:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850335360 00000100:00100000:1.0:1789683818.080335:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850335360 00000100:00100000:1.0:1789683818.080381:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789683818.080391:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850335360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683818.080428:0:23773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683818.080519:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850335360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683818.080526:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789683818.080578:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850335360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683818.092093:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683818.092115:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850335488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683818.092192:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683818.092325:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850335488 00000100:00100000:0.0:1789683818.092334:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850335488 00000100:00100000:0.0:1789683818.092388:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789683818.092398:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850335488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789683818.092432:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789683818.092505:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850335488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683818.092512:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789683818.092643:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850335488:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789683818.656040:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683819.679038:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789683819.952887:0:25090:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789683819.952891:0:25090:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789683819.952893:0:25090:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789683819.953169:0:25090:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0e8108d000 00000020:01000004:3.0:1789683819.953186:0:25090:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789683819.953201:0:25090:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789683819.953215:0:25090:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f0e8240b380) 00000020:00000080:3.0:1789683819.953232:0:25090:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789683819.995198:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789683819.996718:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789683819.996957:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789683819.997176:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789683819.997397:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789683819.997813:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789683819.998054:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00000040:00080000:3.0:1789683819.999452:0:23519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00080000:01000000:3.0:1789683820.004121:0:25090:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789683820.004342:0:25090:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789683820.004354:0:25090:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789683820.004367:0:25090:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf8485587b88b404 00000020:01000004:3.0:1789683820.004381:0:25090:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789683820.004403:0:25090:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789683820.004407:0:25090:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789683820.004412:0:25090:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789683820.004455:0:25090:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789683820.004459:0:25090:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789683820.014356:0:25090:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789683820.014397:0:25090:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.150@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789683820.014402:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789683820.014405:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789683820.014406:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683820.014407:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683820.014409:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683820.014410:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683820.014412:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683820.014414:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683820.014416:0:25090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789683820.014419:0:25090:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789683820.014422:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789683820.014423:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789683820.014424:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683820.014425:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683820.014426:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683820.014427:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683820.014428:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683820.014439:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683820.014440:0:25090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789683820.014470:0:25090:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789683820.014491:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850335616:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789683820.014565:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.014620:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789683820.014691:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850335616 00000100:00100000:1.0:1789683820.014706:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850335616 00000100:00100000:1.0:1789683820.014837:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789683820.014846:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+21:25090:x1876618850335616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789683820.014881:0:22759:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789683820.014884:0:22759:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789683820.014888:0:22759:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789683820.015297:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+21:25090:x1876618850335616:12345-0@lo:253:mount.lustre.0 Request processed in 451us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.015306:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789683820.015477:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850335616:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789683820.015488:0:25090:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789683820.015491:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789683820.015500:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789683820.015501:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683820.015501:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683820.015503:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683820.015504:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683820.015505:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683820.015507:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683820.015508:0:25090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789683820.015530:0:25090:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0e8108d000 from lustre-OST0001 10000000:01000000:3.0:1789683820.015558:0:25090:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789683820.015561:0:25090:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789683820.015569:0:25090:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0f86180000 local copy 00010000:00010000:3.0:1789683820.015581:0:25090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683820.015667:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850335744:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683820.015700:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.015774:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683820.015845:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850335744 00000100:00100000:2.0:1789683820.015850:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850335744 00000100:00100000:2.0:1789683820.015879:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789683820.015886:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+21:25090:x1876618850335744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683820.015968:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+21:25090:x1876618850335744:12345-0@lo:501:mount.lustre.0 Request processed in 83us (267us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683820.015976:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789683820.016104:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850335744:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789683820.016117:0:25090:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789683820.016135:0:25090:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789683820.016141:0:25090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.016149:0:25090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88b037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b03e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683820.016175:0:25090:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0e8108d000 10000000:01000000:3.0:1789683820.016179:0:25090:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789683820.016184:0:25090:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789683820.016186:0:25090:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789683820.016196:0:25090:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789683820.016199:0:25090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789683820.016222:0:25090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.016229:0:25090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.016238:0:25090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683820.016251:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850335872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789683820.016277:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.016304:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683820.016351:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850335872 00000100:00100000:2.0:1789683820.016357:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850335872 00000100:00100000:2.0:1789683820.016374:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789683820.016380:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+21:25090:x1876618850335872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683820.016389:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683820.016403:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b40b expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683820.016423:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b40b expref: 22 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683820.016442:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb7a30200/0xcf8485587b88b412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b40b expref: 22 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683820.016451:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30200, rc 0) 00000100:00100000:2.0:1789683820.016487:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+22:25090:x1876618850335872:12345-0@lo:101:mount.lustre.0 Request processed in 106us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683820.016492:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789683820.016611:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850335872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683820.016624:0:25090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b412 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.016633:0:25090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b412 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683820.020528:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1789683820.021117:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683820.022773:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789683820.022849:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789683820.022865:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789683820.022877:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789683820.022890:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789683820.022921:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789683820.022934:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789683820.022960:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789683820.022987:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1789683820.023015:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1789683820.023021:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1789683820.023124:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683820.023193:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.023244:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683820.023404:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850336000 00000100:00100000:2.0:1789683820.023413:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850336000 00000100:00100000:2.0:1789683820.023476:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789683820.023485:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+22:25090:x1876618850336000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683820.023641:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+22:25090:x1876618850336000:12345-0@lo:501:mount.lustre.0 Request processed in 156us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683820.023649:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789683820.024026:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683820.024065:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683820.024108:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.024138:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683820.024196:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850336128 00000100:00100000:1.0:1789683820.024202:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850336128 00000100:00100000:1.0:1789683820.024237:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789683820.024244:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+22:25090:x1876618850336128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683820.024976:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+22:25090:x1876618850336128:12345-0@lo:503:mount.lustre.0 Request processed in 730us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.024984:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789683820.025067:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336128:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789683820.025484:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789683820.025556:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683820.025601:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.025641:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683820.025705:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850336256 00000100:00100000:1.0:1789683820.025712:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850336256 00000100:00100000:1.0:1789683820.025749:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789683820.025757:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+22:25090:x1876618850336256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683820.026290:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+22:25090:x1876618850336256:12345-0@lo:502:mount.lustre.0 Request processed in 533us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.026298:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789683820.026473:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683820.026656:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789683820.026685:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1789683820.026699:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1789683820.026712:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1789683820.026727:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1789683820.026740:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1789683820.026755:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1789683820.026770:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1789683820.026808:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1789683820.026838:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683820.026882:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.027008:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683820.027045:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850336384 00000100:00100000:1.0:1789683820.027051:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850336384 00000100:00100000:1.0:1789683820.027130:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789683820.027138:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+22:25090:x1876618850336384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683820.027242:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+22:25090:x1876618850336384:12345-0@lo:502:mount.lustre.0 Request processed in 105us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.027249:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789683820.027312:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683820.027352:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1789683820.027360:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789683820.028143:0:25094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789683820.028151:0:25094:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789683820.028157:0:25094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.028160:0:25094:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789683820.028166:0:25094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683820.028182:0:25094:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f0fa5088000) 00000020:00000080:3.0:1789683820.028207:0:25094:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789683820.028213:0:25094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789683820.028290:0:25094:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0e8108d000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789683820.028298:0:25094:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789683820.028305:0:25094:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf8485587b88b420 00010000:00010000:3.0:1789683820.032013:0:25094:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789683820.032476:0:25094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1789683820.033766:0:25094:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789683820.035288:0:25094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789683820.035301:0:25094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683820.035309:0:25094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.035311:0:25094:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789683820.035314:0:25094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683820.035318:0:25094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.035319:0:25094:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789683820.035322:0:25094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789683820.035324:0:25094:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789683820.035326:0:25094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683820.035328:0:25094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.035329:0:25094:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789683820.035339:0:25094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683820.035342:0:25094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.035343:0:25094:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789683820.035347:0:25094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789683820.035372:0:25094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683820.035376:0:25094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.035377:0:25094:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789683820.035380:0:25094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1789683820.035548:0:25090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789683820.035575:0:25090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789683820.035602:0:25090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b412 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.035614:0:25090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3600/0xcf8485587b88b40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b412 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683820.035622:0:25090:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0e8108d000 from 1 10000000:01000000:0.0:1789683820.035625:0:25090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683820.035661:0:25090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.035670:0:25090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.035681:0:25090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683820.035704:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789683820.035772:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683820.035839:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922240 going to sleep for 11 seconds 00000100:00100000:1.0:1789683820.036017:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850336512 00000100:00100000:1.0:1789683820.036025:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850336512 00000100:00100000:1.0:1789683820.036075:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789683820.036084:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+22:25090:x1876618850336512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683820.036097:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683820.036108:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b42e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b427 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.036131:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b42e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b427 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.036141:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b42e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b427 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.036150:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9200, rc 0) 00000100:00100000:1.0:1789683820.036188:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+23:25090:x1876618850336512:12345-0@lo:101:mount.lustre.0 Request processed in 105us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.036195:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789683820.036308:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683820.036324:0:25090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.036334:0:25090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789683820.037289:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1789683820.039190:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683820.039459:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789683820.039487:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789683820.039501:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789683820.039514:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789683820.039529:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789683820.039543:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789683820.039556:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789683820.039568:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789683820.039580:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789683820.039591:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1789683820.039602:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1789683820.039619:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1789683820.039624:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1789683820.039725:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683820.041141:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683820.041183:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683820.041257:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850336640 00000100:00100000:1.0:1789683820.041266:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850336640 00000100:00100000:1.0:1789683820.041317:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789683820.041326:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+23:25090:x1876618850336640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683820.041598:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+23:25090:x1876618850336640:12345-0@lo:501:mount.lustre.0 Request processed in 272us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.041618:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789683820.041696:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683820.041884:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683820.041940:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683820.041965:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683820.042071:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850336768 00000100:00100000:0.0:1789683820.042076:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850336768 00000100:00100000:0.0:1789683820.042114:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789683820.042121:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+23:25090:x1876618850336768:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683820.042209:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+23:25090:x1876618850336768:12345-0@lo:503:mount.lustre.0 Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683820.042216:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789683820.042400:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789683820.042877:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683820.043010:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683820.043057:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683820.043139:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683820.047890:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850336896 00000100:00100000:1.0:1789683820.047972:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850336896 00000100:00100000:1.0:1789683820.048040:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789683820.048050:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+23:25090:x1876618850336896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683820.048260:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+23:25090:x1876618850336896:12345-0@lo:502:mount.lustre.0 Request processed in 210us (5201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.048268:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789683820.048415:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850336896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683820.048704:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789683820.048736:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789683820.048751:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789683820.048765:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789683820.048777:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789683820.048817:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789683820.048833:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789683820.048848:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1789683820.048861:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1789683820.048873:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1789683820.048884:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1789683820.049153:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683820.049211:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683820.049249:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683820.049483:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850337024 00000100:00100000:1.0:1789683820.049490:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850337024 00000100:00100000:1.0:1789683820.049572:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789683820.049581:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+23:25090:x1876618850337024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683820.049702:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+23:25090:x1876618850337024:12345-0@lo:502:mount.lustre.0 Request processed in 121us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.049710:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789683820.051259:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683820.051354:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1789683820.051368:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789683820.052515:0:25098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683820.052525:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.052528:0:25098:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789683820.052535:0:25098:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0e8108d000 00000020:00000080:3.0:1789683820.052538:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683820.052545:0:25098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683820.052548:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.052549:0:25098:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789683820.052552:0:25098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683820.052554:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.052556:0:25098:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789683820.052559:0:25098:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0e8108d000 00000020:00000080:3.0:1789683820.052561:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683820.052620:0:25098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683820.052624:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.052625:0:25098:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789683820.052628:0:25098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683820.052631:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.052632:0:25098:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789683820.052636:0:25098:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0e8108d000 00000020:00000080:3.0:1789683820.052649:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683820.052668:0:25098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683820.052671:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.052672:0:25098:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789683820.052675:0:25098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683820.052677:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.052679:0:25098:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789683820.052682:0:25098:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0e8108d000 00000020:00000080:3.0:1789683820.052684:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683820.052704:0:25098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683820.052707:0:25098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683820.052708:0:25098:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789683820.052711:0:25098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1789683820.053851:0:25090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789683820.053891:0:25090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683820.053979:0:25090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.053992:0:25090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683820.054057:0:25090:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789683820.054060:0:25090:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0e8108d000 10000000:01000000:3.0:1789683820.054064:0:25090:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0e8108d000 10000000:01000000:3.0:1789683820.054068:0:25090:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789683820.054074:0:25090:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0e8108d000 from 1 10000000:01000000:3.0:1789683820.054076:0:25090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789683820.054111:0:25090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2c00/0xcf8485587b88b435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.054120:0:25090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2c00/0xcf8485587b88b435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.054152:0:25090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2c00/0xcf8485587b88b435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683820.054178:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337152:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789683820.054246:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.057051:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683820.057991:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850337152 00000100:00100000:0.0:1789683820.058002:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850337152 00000100:00100000:0.0:1789683820.058059:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789683820.058068:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+23:25090:x1876618850337152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683820.058086:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683820.058114:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b88b43c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b435 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.058145:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b88b43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b435 expref: 24 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.058158:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b88b43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b435 expref: 24 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.058167:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454ce00, rc 0) 00000100:00100000:0.0:1789683820.058242:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850337152:12345-0@lo:101:mount.lustre.0 Request processed in 175us (3995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683820.058249:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789683820.060725:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683820.060756:0:25090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2c00/0xcf8485587b88b435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b43c expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.060770:0:25090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2c00/0xcf8485587b88b435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b43c expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683820.062389:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1789683820.062681:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683820.062988:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789683820.063015:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789683820.063042:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789683820.063056:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789683820.063070:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789683820.063083:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789683820.063095:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789683820.063108:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789683820.063121:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789683820.063134:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789683820.063147:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789683820.063161:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789683820.063186:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789683820.063202:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789683820.063214:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789683820.063226:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789683820.063238:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789683820.063250:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789683820.063262:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789683820.063275:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789683820.063286:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789683820.063297:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789683820.063309:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789683820.063321:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789683820.063334:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1789683820.063347:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1789683820.063359:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1789683820.063370:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1789683820.063393:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1789683820.063405:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1789683820.063416:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1789683820.063427:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1789683820.063456:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1789683820.063469:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1789683820.063480:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1789683820.063504:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1789683820.063517:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1789683820.063530:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1789683820.063541:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1789683820.063555:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1789683820.063567:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1789683820.063580:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1789683820.063593:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1789683820.063605:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1789683820.063631:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1789683820.063646:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1789683820.063659:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1789683820.063669:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1789683820.064980:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1789683820.065036:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1789683820.065061:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1789683820.065068:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1789683820.065165:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683820.065229:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683820.065263:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e835a5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683820.066029:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850337280 00000100:00100000:0.0:1789683820.066038:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850337280 00000100:00100000:0.0:1789683820.066084:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789683820.066093:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850337280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683820.066241:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850337280:12345-0@lo:501:mount.lustre.0 Request processed in 149us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683820.066249:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789683820.066295:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683820.066338:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683820.066381:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683820.066409:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9054a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789683820.066476:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850337408 00000100:00100000:1.0:1789683820.066481:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850337408 00000100:00100000:1.0:1789683820.066505:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789683820.066511:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850337408:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683820.066592:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850337408:12345-0@lo:503:mount.lustre.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.066599:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789683820.066687:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337408:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789683820.068310:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683820.068399:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683820.068484:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683820.068513:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9054a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789683820.069016:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850337536 00000100:00100000:1.0:1789683820.069024:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850337536 00000100:00100000:1.0:1789683820.069070:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789683820.069084:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850337536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683820.069188:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850337536:12345-0@lo:502:mount.lustre.0 Request processed in 105us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.069196:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789683820.071907:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683820.072189:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789683820.072217:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789683820.072228:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789683820.072239:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789683820.072250:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789683820.072261:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789683820.072271:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789683820.072289:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789683820.072300:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789683820.072310:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789683820.072321:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789683820.072332:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789683820.072342:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789683820.072355:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789683820.072366:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789683820.072377:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789683820.072387:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789683820.072397:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789683820.072408:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789683820.072418:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789683820.072442:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789683820.072457:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789683820.072468:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789683820.072480:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789683820.072491:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1789683820.072502:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1789683820.072512:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1789683820.072523:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1789683820.072534:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1789683820.072545:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1789683820.072555:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1789683820.072566:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1789683820.072593:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1789683820.072606:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1789683820.072616:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1789683820.072627:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1789683820.072637:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1789683820.072648:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1789683820.072658:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1789683820.072669:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1789683820.072686:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1789683820.072697:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1789683820.072708:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1789683820.072730:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1789683820.072742:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1789683820.072753:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1789683820.072763:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1789683820.072774:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1789683820.072851:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683820.072916:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683820.072958:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850337664 00000100:00100000:2.0:1789683820.072965:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850337664 00000100:00100000:2.0:1789683820.073005:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789683820.073013:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850337664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683820.073103:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850337664:12345-0@lo:502:mount.lustre.0 Request processed in 90us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683820.073111:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789683820.073158:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88102f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683820.073170:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683820.073278:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1789683820.073295:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1789683820.073312:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337792:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683820.073340:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683820.073360:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850337792 00000100:00100000:2.0:1789683820.073363:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850337792 00000100:00100000:2.0:1789683820.073382:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789683820.073387:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850337792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683820.073459:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850337792:12345-0@lo:502:mount.lustre.0 Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683820.073465:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789683820.073497:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88102f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683820.073509:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850337792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683820.073540:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1789683820.073547:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789683820.083049:0:25103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789683820.083068:0:25103:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f0fa508cd40) 00000020:00000080:3.0:1789683820.083094:0:25103:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789683820.083190:0:25103:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0e8108d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789683820.083194:0:25103:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0e8108d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789683820.083197:0:25103:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0e8108d000 3 00010000:00080000:3.0:1789683820.083229:0:25103:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e8343b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789683820.084939:0:25103:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789683820.085142:0:25103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789683820.085184:0:25103:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789683820.085204:0:25103:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcf8485587b88b44a 00000100:00080000:3.0:1789683820.085214:0:25103:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683820.085225:0:25103:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0e8343b000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683820.085265:0:25103:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7d86300 x1876618850337920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683820.085302:0:25103:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789683820.085496:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850337920:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789683820.085573:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789683820.086998:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683820.087003:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683820.087007:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c34000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683820.087015:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 729 00000100:00080000:1.0:1789683820.087020:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789683820.087031:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0e83c34000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683820.087051:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83eaca80 x1876618850338304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683820.087094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683820.087097:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683820.087099:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5185800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683820.087102:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 729 00000100:00080000:1.0:1789683820.087104:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789683820.087109:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0fb5185800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683820.087119:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83ead500 x1876618850338816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683820.087166:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850338048:0@lo:400:kworker.0 00000100:00100000:1.0:1789683820.087221:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683820.087256:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850338688:0@lo:400:kworker.0 00000100:00100000:1.0:1789683820.087281:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683820.087303:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789683820.087309:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850338176:0@lo:400:kworker.0 00000100:00100000:1.0:1789683820.087329:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683820.087353:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850338944:0@lo:400:kworker.0 00000100:00100000:1.0:1789683820.087374:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683820.087555:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850338048 00000100:00100000:1.0:1789683820.087563:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850338048 00000100:00100000:1.0:1789683820.087611:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789683820.087621:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850338048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683820.087683:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850338048:12345-0@lo:400:kworker.0 Request processed in 63us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.087691:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789683820.090846:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850337920 00000100:00100000:3.0:1789683820.090861:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850337920 00000100:00100000:3.0:1789683820.090907:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850338944 00000100:00100000:3.0:1789683820.090911:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850338944 00000100:00100000:3.0:1789683820.090941:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683820.090951:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850338944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683820.091047:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850338944:12345-0@lo:400:kworker.0 Request processed in 97us (3671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683820.091055:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683820.091073:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683820.091077:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876618850337920:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789683820.091112:0:22767:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 734 last 0 00000020:00000080:3.0:1789683820.091149:0:22767:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcf8485587b88b451 00000004:00100000:3.0:1789683820.091164:0:22767:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789683820.091196:0:22767:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d1f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683820.091230:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876618850337920:12345-0@lo:38:llog_process_th.0 Request processed in 151us (5657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683820.091237:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683820.091271:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850338560:0@lo:400:kworker.0 00000100:00100000:3.0:1789683820.091314:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.091340:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850339200:0@lo:400:kworker.0 00000100:00100000:3.0:1789683820.091361:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.091380:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789683820.091387:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850338432:0@lo:400:kworker.0 00000100:00100000:2.0:1789683820.091635:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850338688 00000100:00100000:0.0:1789683820.091635:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850338176 00000100:00100000:2.0:1789683820.091641:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850338688 00000100:00100000:0.0:1789683820.091641:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850338176 00000100:00100000:1.0:1789683820.091708:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850338304:0@lo:8:kworker.0 00000100:00100000:1.0:1789683820.091758:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683820.091781:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850338816:0@lo:8:kworker.0 00000100:00100000:1.0:1789683820.091817:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789683820.091850:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fa7d86300 x1876618850337920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683820.091861:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789683820.091870:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1789683820.091877:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789683820.091883:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789683820.091885:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e8343b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789683820.091891:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850337920:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789683820.091940:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eaea00 x1876618850338944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683820.091951:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850338944:0@lo:400:kworker.0 00000100:00100000:1.0:1789683820.091962:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850338048:0@lo:400:kworker.0 00000100:00100000:0.0:1789683820.092764:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850338304 00000100:00100000:0.0:1789683820.092773:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850338304 00000100:00100000:0.0:1789683820.092797:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850338816 00000100:00100000:0.0:1789683820.092800:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850338816 00000100:00100000:0.0:1789683820.092812:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683820.092820:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850338176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683820.092892:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850338176:12345-0@lo:400:kworker.0 Request processed in 74us (5561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683820.092899:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683820.092915:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683820.092918:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1876618850338304:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789683820.092965:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1876618850338304:12345-0@lo:8:kworker.0 Request processed in 44us (1206us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789683820.092971:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683820.092983:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683820.092987:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1876618850338816:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789683820.093018:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1876618850338816:12345-0@lo:8:kworker.0 Request processed in 29us (1200us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789683820.093023:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683820.093043:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850338560 00000100:00100000:0.0:1789683820.093047:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850338560 00000100:00100000:0.0:1789683820.093071:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789683820.093077:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850338560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683820.093111:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850338560:12345-0@lo:400:kworker.0 Request processed in 35us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683820.093127:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683820.093288:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.093311:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850339072:0@lo:400:kworker.0 00000100:00100000:3.0:1789683820.093336:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.093358:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850338560:0@lo:400:kworker.0 00000100:00100000:3.0:1789683820.093385:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850339200 00000100:00100000:3.0:1789683820.093389:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850339200 00000100:00100000:1.0:1789683820.094607:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850338176:0@lo:400:kworker.0 00000100:00100000:2.0:1789683820.096754:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683820.096767:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850338688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683820.096882:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850338688:12345-0@lo:400:kworker.0 Request processed in 118us (9599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683820.096889:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683820.097096:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850338688:0@lo:400:kworker.0 00000100:00080000:0.0:1789683820.100496:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683820.100506:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683820.100562:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683820.100570:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c34000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683820.100577:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789683820.100582:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850338304:0@lo:8:kworker.0 00000100:00100000:0.0:1789683820.100593:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683820.100596:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5185800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683820.100599:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789683820.100601:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850338816:0@lo:8:kworker.0 00000100:00100000:0.0:1789683820.102039:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850338432 00000100:00100000:0.0:1789683820.102049:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850338432 00000100:00100000:0.0:1789683820.102089:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850339072 00000100:00100000:0.0:1789683820.102092:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850339072 00000100:00100000:0.0:1789683820.102129:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683820.102137:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850338432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683820.102236:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850338432:12345-0@lo:400:kworker.0 Request processed in 99us (8947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683820.102243:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683820.102260:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683820.102267:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850339072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683820.102297:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850339072:12345-0@lo:400:kworker.0 Request processed in 32us (8960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683820.102303:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789683820.102346:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83ead180 x1876618850338432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683820.102360:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850338432:0@lo:400:kworker.0 00010000:00080000:0.0:1789683820.102375:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eae300 x1876618850339072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683820.102382:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850339072:0@lo:400:kworker.0 00000100:00080000:1.0:1789683820.102548:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:0.0:1789683820.104024:0:25103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789683820.104041:0:25103:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9f0fa719cd40) 00000020:00000080:0.0:1789683820.104065:0:25103:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789683820.104176:0:25103:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0e8108d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789683820.104180:0:25103:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0e8108d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789683820.104182:0:25103:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0e8108d000 3 00010000:00080000:0.0:1789683820.104212:0:25103:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e8374d800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.150@tcp at head 00010000:00010000:0.0:1789683820.112090:0:25103:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1789683820.115267:0:25103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789683820.115328:0:25103:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000100:00100000:3.0:1789683820.115700:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683820.115726:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850339200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683820.115843:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850339200:12345-0@lo:400:kworker.0 Request processed in 133us (24479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683820.115851:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00000080:0.0:1789683820.116264:0:25103:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcf8485587b88b45f 00000100:00080000:0.0:1789683820.116274:0:25103:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789683820.116283:0:25103:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f0e8374d800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683820.116319:0:25103:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb61f1880 x1876618850339328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683820.116360:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1876618850339328:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789683820.116406:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789683820.116463:0:25103:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789683820.116468:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850339328 00000100:00100000:2.0:1789683820.116476:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850339328 00000100:00100000:2.0:1789683820.116499:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683820.116505:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876618850339328:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789683820.116529:0:22767:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 734 last 0 00010000:00080000:3.0:1789683820.116552:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e8451fb80 x1876618850339200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683820.116564:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850339200:0@lo:400:kworker.0 00000020:00000080:2.0:1789683820.116582:0:22767:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcf8485587b88b466 00000004:00100000:2.0:1789683820.116599:0:22767:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789683820.116630:0:22767:0:(import.c:65:import_set_state_nolock()) ffff9f0e8450c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683820.116680:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876618850339328:12345-0@lo:38:llog_process_th.0 Request processed in 174us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683820.116697:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789683820.118390:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb61f1880 x1876618850339328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683820.118427:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683820.121199:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1789683820.121209:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789683820.121215:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789683820.121219:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e8374d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789683820.121231:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1876618850339328:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789683820.121394:0:25103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1789683820.121726:0:25090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789683820.122010:0:25090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683820.122028:0:25090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2c00/0xcf8485587b88b435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b43c expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683820.122039:0:25090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2c00/0xcf8485587b88b435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b43c expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789683820.122096:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789683820.122098:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683820.122099:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683820.122100:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683820.122101:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683820.122102:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683820.122104:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683820.122105:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683820.122106:0:25090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683820.122110:0:25090:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789683820.122113:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683820.122114:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683820.122115:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683820.122116:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683820.122117:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683820.122118:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683820.122119:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683820.122120:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683820.122121:0:25090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683820.122141:0:25090:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789683820.122160:0:25090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850339456:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789683820.122233:0:25090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683820.122267:0:25090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc1500f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683820.122288:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850339456 00000100:00100000:2.0:1789683820.122300:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850339456 00000100:00100000:2.0:1789683820.122342:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789683820.122351:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850339456:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789683820.122377:0:22761:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789683820.122394:0:22761:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789683820.142983:0:22761:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789683820.143010:0:22761:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789683820.143422:0:22782:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789683820.143438:0:22782:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789683820.143461:0:22782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.143480:0:22782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b2f3 expref: 24 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.143487:0:22782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b301 expref: 24 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.143494:0:22782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.143536:0:22782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b301 expref: 24 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.143550:0:22782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b308 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b301 expref: 24 pid: 22760 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683820.143564:0:22782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850339584:0@lo:104: 00000100:00100000:1.0:1789683820.143632:0:22782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.143705:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850339584 00010000:00010000:1.0:1789683820.143709:0:22782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b2f3 expref: 24 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.143718:0:22782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b2fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b2f3 expref: 24 pid: 22761 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683820.143727:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850339584 00000100:00100000:1.0:1789683820.143727:0:22782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850339712:0@lo:104: 00000100:00100000:1.0:1789683820.143750:0:22782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683820.143773:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8b80bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683820.144348:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:25090:x1876618850339456:12345-0@lo:253:mount.lustre.0 Request processed in 21996us (22111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683820.144359:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789683820.144458:0:25090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:acf86134-5469-4898-92a9-e106d5944cd1:25090:1876618850339456:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789683820.144469:0:25090:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789683820.144472:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789683820.144474:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683820.144475:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683820.144477:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683820.144478:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683820.144497:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683820.144499:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683820.144501:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683820.144502:0:25090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789683820.144518:0:25090:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789683820.148124:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850339712 00000100:00100000:0.0:1789683820.148140:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850339712 00000100:00100000:1.0:1789683820.148939:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683820.148952:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+4:22782:x1876618850339584:12345-0@lo:104: 00010000:00010000:1.0:1789683820.148970:0:22750:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683820.149094:0:22782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850339584:0@lo:104: 00010000:00010000:1.0:1789683820.149114:0:22750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683820.149119:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+4:22782:x1876618850339584:12345-0@lo:104: Request processed in 172us (5488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.149127:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789683820.149147:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683820.149153:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.149161:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683820.149165:0:22755:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.149174:0:22755:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683820.149202:0:22755:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683820.149208:0:22755:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789683820.149248:0:22755:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.149255:0:22755:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683820.149274:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.149281:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31a00/0xcf8485587b88b301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b308 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.149293:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683820.149294:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683820.149296:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683820.149303:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683820.149316:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850339840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683820.149352:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683820.149394:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850339840 00000100:00100000:1.0:1789683820.149399:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850339840 00010000:00010000:1.0:1789683820.149418:0:22752:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b308 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b301 expref: 24 pid: 22760 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683820.149455:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683820.149462:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:acf86134-5469-4898-92a9-e106d5944cd1+24:3650:x1876618850339840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683820.149473:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683820.149485:0:22752:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b308 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b301 expref: 24 pid: 22760 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.149495:0:22752:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b301 expref: 24 pid: 22760 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.149508:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b301 expref: 24 pid: 22760 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.149519:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683820.149548:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:acf86134-5469-4898-92a9-e106d5944cd1+23:3650:x1876618850339840:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.149554:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683820.149583:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850339840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683820.149608:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683820.149616:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+3:22782:x1876618850339712:12345-0@lo:104: 00010000:00010000:1.0:1789683820.149624:0:22750:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683820.149675:0:22750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683820.149680:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:acf86134-5469-4898-92a9-e106d5944cd1+3:22782:x1876618850339712:12345-0@lo:104: Request processed in 66us (5930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.149685:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789683820.150037:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683820.150043:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.150050:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454de00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683820.150054:0:23923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.150061:0:23923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683820.150067:0:23923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683820.150073:0:23923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683820.150090:0:23923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.150095:0:23923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683820.150118:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.150124:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f8454de00/0xcf8485587b88b2f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b2fa expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.150138:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683820.150140:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683820.150142:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683820.150211:0:22782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22782:1876618850339712:0@lo:104: 00010000:00010000:0.0:1789683820.150227:0:22782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683820.150455:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683820.150466:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850339968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683820.150500:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683820.150579:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850339968 00000100:00100000:3.0:1789683820.150584:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850339968 00010000:00010000:3.0:1789683820.150605:0:22753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b2fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b2f3 expref: 23 pid: 22761 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683820.150626:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683820.150632:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acf86134-5469-4898-92a9-e106d5944cd1+23:3649:x1876618850339968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683820.150641:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683820.150645:0:22753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b2fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b2f3 expref: 23 pid: 22761 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.150654:0:22753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b2f3 expref: 23 pid: 22761 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.150664:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b2fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b2f3 expref: 23 pid: 22761 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.150674:0:22753:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.151079:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789683820.151095:0:22753:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007668550s 00010000:00010000:3.0:1789683820.151100:0:22753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.151106:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.151112:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.151118:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.151123:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683820.151127:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.151134:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.151506:0:22782:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683820.151516:0:22782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.151548:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.151556:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88b46d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683820.151570:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683820.151624:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acf86134-5469-4898-92a9-e106d5944cd1+22:3649:x1876618850339968:12345-0@lo:103:ldlm_bl.0 Request processed in 991us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683820.151632:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789683820.158525:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850339968:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1789683820.159502:0:25090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1789683820.162318:0:25090:0:(ofd_obd.c:547:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789683820.162329:0:25090:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789683820.162379:0:25090:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789683820.162437:0:25090:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789683820.162452:0:25090:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789683820.162471:0:25090:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789683820.163457:0:25090:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683820.163688:0:25090:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789683820.644296:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683820.644321:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850340096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683820.647215:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683820.647318:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850340096 00000100:00100000:1.0:1789683820.647397:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850340096 00000100:00100000:1.0:1789683820.647465:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683820.647476:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850340096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683820.647506:0:24280:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789683820.650823:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850340096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3336us (3597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683820.650841:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683820.654627:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850340096:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789683820.703046:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789683821.279578:0:22763:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789683821.279586:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fa7d90800 from 14 10000000:01000000:3.0:1789683821.279592:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789683821.279646:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.279660:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.279672:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683821.279700:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850340224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683821.279772:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683821.279825:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210240 going to sleep for 11 seconds 00000100:00100000:3.0:1789683821.279845:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850340224 00000100:00100000:3.0:1789683821.279852:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850340224 00000100:00100000:3.0:1789683821.279899:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789683821.279907:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+22:22763:x1876618850340224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683821.279931:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683821.279944:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb1bc3a00/0xcf8485587b88b47b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b474 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.279968:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb1bc3a00/0xcf8485587b88b47b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b474 expref: 23 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.279978:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb1bc3a00/0xcf8485587b88b47b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b474 expref: 23 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.279988:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc3a00, rc 0) 00000100:00100000:3.0:1789683821.280029:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+23:22763:x1876618850340224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683821.280037:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789683821.280085:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850340224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683821.280099:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b474 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b47b expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.280107:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b474 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b47b expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683821.280153:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850340352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789683821.280184:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683821.280199:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210240 going to sleep for 11 seconds 00000100:00100000:3.0:1789683821.280211:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850340352 00000100:00100000:3.0:1789683821.280215:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850340352 00000100:00100000:3.0:1789683821.280236:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789683821.280242:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+23:22763:x1876618850340352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789683821.280263:0:22761:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789683821.280278:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789683821.280281:0:22761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789683821.280376:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+23:22763:x1876618850340352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683821.280383:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789683821.280423:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850340352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789683821.280476:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683821.280483:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b474 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b47b expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.280491:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc3200/0xcf8485587b88b474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b47b expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683821.280500:0:22763:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789683821.280502:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fc06b2000 from 14 10000000:01000000:3.0:1789683821.280504:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789683821.280520:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2600/0xcf8485587b88b482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.280527:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2600/0xcf8485587b88b482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.280534:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2600/0xcf8485587b88b482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683821.280546:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850340480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683821.280572:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683821.280593:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210240 going to sleep for 11 seconds 00000100:00100000:3.0:1789683821.280605:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850340480 00000100:00100000:3.0:1789683821.280609:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850340480 00000100:00100000:3.0:1789683821.280630:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789683821.280637:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+23:22763:x1876618850340480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683821.280645:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683821.280653:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b482 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.280666:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b482 expref: 24 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.280675:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb1bc3800/0xcf8485587b88b489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b482 expref: 24 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.280682:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc3800, rc 0) 00000100:00100000:3.0:1789683821.280709:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+24:22763:x1876618850340480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683821.280714:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789683821.280743:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850340480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683821.280753:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2600/0xcf8485587b88b482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b489 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.280761:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2600/0xcf8485587b88b482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b489 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683821.280826:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850340608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789683821.280855:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683821.280880:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210240 going to sleep for 11 seconds 00000100:00100000:3.0:1789683821.280890:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850340608 00000100:00100000:3.0:1789683821.280894:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850340608 00000100:00100000:3.0:1789683821.280916:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789683821.280921:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+24:22763:x1876618850340608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789683821.280931:0:22760:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789683821.280940:0:22760:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789683821.280943:0:22760:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789683821.281002:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+24:22763:x1876618850340608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 80us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683821.281008:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789683821.281038:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850340608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789683821.281075:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683821.281081:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2600/0xcf8485587b88b482 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b489 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683821.281088:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2600/0xcf8485587b88b482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b489 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:1.0:1789683821.361115:0:25157:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683821.363709:0:25157:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789683821.734905:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683822.435365:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789683822.698144:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850340736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683822.698229:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683822.698318:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850340736 00000100:00100000:2.0:1789683822.698326:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850340736 00000100:00100000:2.0:1789683822.698375:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683822.698396:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850340736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683822.698426:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683822.698469:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850340736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683822.698475:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789683822.698495:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683822.698528:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850340736:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789683822.762980:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683823.200275:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850340864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683823.200352:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683823.200421:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850340864 00000100:00100000:2.0:1789683823.200429:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850340864 00000100:00100000:2.0:1789683823.200477:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789683823.200486:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850340864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683823.200522:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789683823.200570:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850340864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683823.200577:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789683823.200644:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850340864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683823.201767:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850340992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683823.201875:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683823.202096:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850340992 00000100:00100000:1.0:1789683823.202104:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850340992 00000100:00100000:1.0:1789683823.202148:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789683823.202157:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850340992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683823.202190:0:23773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789683823.202233:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850340992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683823.202239:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683823.202366:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850340992:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789683823.779190:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683824.802956:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789683825.247377:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683825.247384:0:14530:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683825.247387:0:14530:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c34000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683825.247404:0:14530:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0e83c34000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683825.247424:0:14530:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e8451c380 x1876618850341504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683825.247465:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683825.247468:0:14530:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683825.247470:0:14530:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5185800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683825.247475:0:14530:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0fb5185800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683825.247485:0:14530:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e8451d880 x1876618850342016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683825.247546:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850341120:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.247610:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.247647:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850341760:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.247670:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.247688:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850342400:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.247708:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.247730:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789683825.247736:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850341248:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.247759:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.247774:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850341888:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.247823:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.247840:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850342528:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.247857:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.247879:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850341376:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.247902:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.247917:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850342144:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.247935:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.247951:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850342656:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.247973:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.247985:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789683825.247990:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850341632:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.248007:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.248017:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850342272:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.248045:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.248147:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850341120 00000100:00100000:1.0:1789683825.248156:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850341120 00000100:00100000:1.0:1789683825.248205:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789683825.248215:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:3647:x1876618850341120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.248544:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:3647:x1876618850341120:12345-0@lo:400:kworker.0 Request processed in 330us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683825.248552:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789683825.248585:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850341760 00000100:00100000:1.0:1789683825.248589:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850341760 00000100:00100000:1.0:1789683825.248613:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850341248 00000100:00100000:1.0:1789683825.248615:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850341248 00000100:00100000:1.0:1789683825.248628:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789683825.248634:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850341760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.248668:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850341760:12345-0@lo:400:kworker.0 Request processed in 35us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683825.248674:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789683825.248686:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789683825.248691:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850341248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.248718:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850341248:12345-0@lo:400:kworker.0 Request processed in 27us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683825.248724:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789683825.248741:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850342400 00000100:00100000:1.0:1789683825.248746:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850342400 00000100:00100000:1.0:1789683825.248775:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850342528 00000100:00100000:1.0:1789683825.248778:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850342528 00000100:00100000:1.0:1789683825.248822:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850342144 00000100:00100000:1.0:1789683825.248825:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850342144 00000100:00100000:1.0:1789683825.248849:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850342656 00000100:00100000:1.0:1789683825.248852:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850342656 00000100:00100000:1.0:1789683825.248863:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850341632 00000100:00100000:1.0:1789683825.248866:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850341632 00000100:00100000:1.0:1789683825.248873:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850342272 00000100:00100000:1.0:1789683825.248875:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850342272 00000100:00100000:1.0:1789683825.248888:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789683825.248893:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850342400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.248925:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850342400:12345-0@lo:400:kworker.0 Request processed in 32us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683825.248932:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789683825.248944:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789683825.248950:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850342528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.248976:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850342528:12345-0@lo:400:kworker.0 Request processed in 27us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683825.248982:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789683825.248995:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683825.249000:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850342144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.249032:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850342144:12345-0@lo:400:kworker.0 Request processed in 32us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683825.249037:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683825.249048:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789683825.249210:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850341504:0@lo:8:kworker.0 00000100:00100000:0.0:1789683825.249245:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683825.249268:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850342016:0@lo:8:kworker.0 00000100:00100000:0.0:1789683825.249289:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683825.249461:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850341888 00000100:00100000:0.0:1789683825.249466:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850341888 00000100:00100000:0.0:1789683825.249498:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850341376 00000100:00100000:0.0:1789683825.249501:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850341376 00000100:00100000:0.0:1789683825.249511:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850341504 00000100:00100000:0.0:1789683825.249513:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850341504 00000100:00100000:0.0:1789683825.249519:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850342016 00000100:00100000:0.0:1789683825.249521:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850342016 00000100:00100000:0.0:1789683825.249530:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789683825.249535:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850341888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683825.249567:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850341888:12345-0@lo:400:kworker.0 Request processed in 33us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683825.249573:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789683825.249585:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683825.249591:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850341376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683825.249617:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850341376:12345-0@lo:400:kworker.0 Request processed in 27us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683825.249622:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683825.249633:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683825.249637:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1876618850341504:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789683825.249665:0:24279:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:0.0:1789683825.249693:0:24279:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88b490 00002000:00100000:0.0:1789683825.249707:0:24279:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f0e81faa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789683825.249711:0:24279:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789683825.249714:0:24279:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789683825.249907:0:24279:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789683825.249929:0:24279:0:(import.c:65:import_set_state_nolock()) ffff9f0e81fae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683825.249969:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876618850341504:12345-0@lo:8:kworker.0 Request processed in 329us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683825.249984:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683825.249997:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683825.250001:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1876618850342016:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789683825.250016:0:24279:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:0.0:1789683825.250030:0:24279:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88b497 00002000:00100000:0.0:1789683825.250036:0:24279:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9f0e81fae000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789683825.250039:0:24279:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789683825.250041:0:24279:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789683825.250161:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850342656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.250199:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850342656:12345-0@lo:400:kworker.0 Request processed in 1146us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683825.250206:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683825.250220:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789683825.250233:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850341632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.250279:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850341632:12345-0@lo:400:kworker.0 Request processed in 47us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683825.250285:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789683825.250298:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789683825.250304:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850342272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.250331:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850342272:12345-0@lo:400:kworker.0 Request processed in 28us (2286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683825.250347:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789683825.250392:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683825.250397:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683825.250399:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789683825.250433:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8451d180 x1876618850341632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683825.250448:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850341632:0@lo:400:kworker.0 00010000:00080000:1.0:1789683825.250462:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc1c6a300 x1876618850342272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683825.250470:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850342272:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.250483:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850341376:0@lo:400:kworker.0 00010000:00080000:1.0:1789683825.250494:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8451fb80 x1876618850342144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683825.250502:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850342144:0@lo:400:kworker.0 00010000:00080000:1.0:1789683825.250511:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83ead180 x1876618850342656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683825.250532:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850342656:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.250582:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850341248:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.250594:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850341888:0@lo:400:kworker.0 00010000:00080000:1.0:1789683825.250605:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83eae300 x1876618850342528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683825.250613:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850342528:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.250623:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850341120:0@lo:400:kworker.0 00000100:00100000:1.0:1789683825.250635:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850341760:0@lo:400:kworker.0 00010000:00080000:1.0:1789683825.250646:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc1c68700 x1876618850342400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683825.250654:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc1c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850342400:0@lo:400:kworker.0 00002000:00080000:0.0:1789683825.250735:0:24279:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789683825.250755:0:24279:0:(import.c:65:import_set_state_nolock()) ffff9f0e8374f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683825.250819:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1876618850342016:12345-0@lo:8:kworker.0 Request processed in 816us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683825.250827:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789683825.250859:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8451c380 x1876618850341504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683825.250870:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789683825.250878:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789683825.250883:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789683825.250885:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c34000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789683825.250908:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789683825.250914:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850341504:0@lo:8:kworker.0 00010000:00080000:0.0:1789683825.250927:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8451d880 x1876618850342016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683825.250935:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789683825.250939:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789683825.250949:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789683825.250951:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5185800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789683825.250961:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789683825.250965:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850342016:0@lo:8:kworker.0 00000004:00080000:0.0:1789683825.250988:0:22792:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789683825.251125:0:22792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739300339938ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789683825.251133:0:22792:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789683825.251183:0:23512:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789683825.251206:0:23512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23512:1876618850342912:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789683825.251239:0:23512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683825.251258:0:23512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f91d64540 going to sleep for 11 seconds 00000004:00080000:1.0:1789683825.252247:0:22793:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1789683825.252271:0:22793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d60a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22793:1876618850343168:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789683825.252317:0:22793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.252349:0:22793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea000 going to sleep for 11 seconds 00000004:00080000:1.0:1789683825.252367:0:23511:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789683825.252436:0:23511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 739301651550ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789683825.252442:0:23511:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789683825.252619:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850342912 00000100:00100000:1.0:1789683825.252626:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850342912 00000100:00100000:1.0:1789683825.252670:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850343168 00000100:00100000:1.0:1789683825.252673:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850343168 00000100:00100000:1.0:1789683825.252706:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683825.252714:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23512:x1876618850342912:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789683825.252893:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683825.252904:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850343040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683825.252938:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683825.253698:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850342784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683825.253748:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683825.253758:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22793:x1876618850343168:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1789683825.253863:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683825.258964:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683825.265069:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850343040 00000100:00100000:3.0:1789683825.265081:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850343040 00000100:00100000:3.0:1789683825.265122:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850342784 00000100:00100000:3.0:1789683825.265125:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850342784 00000100:00100000:3.0:1789683825.265153:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683825.265162:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850343040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683825.265195:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789683825.265317:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850343040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (12377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683825.265324:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683825.265351:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683825.265357:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1876618850342784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789683825.265367:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789683825.265395:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1876618850342784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (6441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683825.265401:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789683825.265938:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7d61f80 x1876618850343040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683825.265961:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850343040:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789683825.271514:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f1180 x1876618850342784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789683825.271527:0:22746:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789683825.271545:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850342784:0@lo:13:osp-pre-1-1.0 00002000:00080000:1.0:1789683825.275439:0:24278:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789683825.275450:0:24278:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789683825.275554:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23512:x1876618850342912:12345-0@lo:7:osp-pre-1-1.0 Request processed in 22837us (24310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683825.275567:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789683825.275998:0:23512:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f2680 x1876618850342912/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789683841 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683825.276017:0:23512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23512:1876618850342912:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789683825.276032:0:23512:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789683825.276071:0:23512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23512:1876618850343296:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789683825.276108:0:23512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683825.276136:0:23512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f84e2ce40 going to sleep for 11 seconds 00002000:00080000:1.0:1789683825.276176:0:24277:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789683825.276184:0:24277:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1789683825.276189:0:24277:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000100:00100000:0.0:1789683825.277528:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850343296 00000100:00100000:0.0:1789683825.277544:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850343296 00000100:00100000:0.0:1789683825.277609:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789683825.277621:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23512:x1876618850343296:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789683825.277665:0:24715:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789683825.277734:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23512:x1876618850343296:12345-0@lo:5:osp-pre-1-1.0 Request processed in 115us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683825.277742:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789683825.277861:0:23512:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f2680 x1876618850343296/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683841 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683825.277876:0:23512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23512:1876618850343296:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789683825.277889:0:23512:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789683825.277928:0:23512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23512:1876618850343424:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789683825.277960:0:23512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683825.277981:0:23512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f84e2ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683825.285948:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850343424 00000100:00100000:0.0:1789683825.285964:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850343424 00000100:00100000:0.0:1789683825.286037:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789683825.286049:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23512:x1876618850343424:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789683825.286106:0:24278:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:2.0:1789683825.288467:0:23501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1789683825.309268:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683825.309282:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000887b3c5d/0xcf8485587b88b49e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.309301:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1789683825.309306:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683825.309313:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000887b3c5d/0xcf8485587b88b49e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.309331:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000887b3c5d/0xcf8485587b88b49e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.309356:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000887b3c5d/0xcf8485587b88b49e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.309376:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000887b3c5d/0xcf8485587b88b49e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.309402:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789683825.310831:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683825.310842:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fb82b8/0xcf8485587b88b4a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.310856:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1789683825.310861:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683825.310865:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fb82b8/0xcf8485587b88b4a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.310878:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2fb82b8/0xcf8485587b88b4a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.310887:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fb82b8/0xcf8485587b88b4a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.310895:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fb82b8/0xcf8485587b88b4a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.310914:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789683825.311027:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683825.311034:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000887b3c5d/0xcf8485587b88b49e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.311049:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.311054:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000887b3c5d/0xcf8485587b88b49e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.311063:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000887b3c5d/0xcf8485587b88b49e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.311079:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000887b3c5d/0xcf8485587b88b49e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.311086:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000887b3c5d/0xcf8485587b88b49e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.311105:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683825.311108:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2fb82b8/0xcf8485587b88b4a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.311115:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.311118:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fb82b8/0xcf8485587b88b4a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.311125:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fb82b8/0xcf8485587b88b4a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.311137:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2fb82b8/0xcf8485587b88b4a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.311151:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2fb82b8/0xcf8485587b88b4a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.311164:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.311166:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.311168:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683825.311746:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789683825.311970:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789683825.311977:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edd3aeae/0xcf8485587b88b4ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683825.311988:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789683825.311992:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683825.311997:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edd3aeae/0xcf8485587b88b4ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683825.312010:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edd3aeae/0xcf8485587b88b4ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683825.312024:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edd3aeae/0xcf8485587b88b4ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683825.312031:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edd3aeae/0xcf8485587b88b4ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683825.312049:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683825.312213:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683825.312219:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edd3aeae/0xcf8485587b88b4ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.312228:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.312233:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edd3aeae/0xcf8485587b88b4ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.312241:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edd3aeae/0xcf8485587b88b4ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.312255:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edd3aeae/0xcf8485587b88b4ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.312262:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edd3aeae/0xcf8485587b88b4ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.312278:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.312280:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.312282:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683825.318001:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683825.318017:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ef6b01e/0xcf8485587b88b4b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.318036:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=739s v=(0 0) 00010000:00010000:2.0:1789683825.318041:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683825.318047:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef6b01e/0xcf8485587b88b4b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.318064:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ef6b01e/0xcf8485587b88b4b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.318076:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ef6b01e/0xcf8485587b88b4b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.318084:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ef6b01e/0xcf8485587b88b4b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.318105:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683825.319716:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683825.319728:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ef6b01e/0xcf8485587b88b4b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.319742:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.319747:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ef6b01e/0xcf8485587b88b4b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.319759:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ef6b01e/0xcf8485587b88b4b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.319780:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ef6b01e/0xcf8485587b88b4b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.319817:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ef6b01e/0xcf8485587b88b4b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.319841:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.319843:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.319845:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683825.321378:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683825.321395:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63fe234/0xcf8485587b88b4ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.321410:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=739s v=(0 0) 00010000:00010000:2.0:1789683825.321414:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683825.321420:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b63fe234/0xcf8485587b88b4ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.321432:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b63fe234/0xcf8485587b88b4ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.321442:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63fe234/0xcf8485587b88b4ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.321450:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b63fe234/0xcf8485587b88b4ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.321470:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683825.321981:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683825.321988:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b63fe234/0xcf8485587b88b4ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.321998:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683825.322002:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63fe234/0xcf8485587b88b4ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.322012:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63fe234/0xcf8485587b88b4ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.322034:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b63fe234/0xcf8485587b88b4ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.322042:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b63fe234/0xcf8485587b88b4ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.322060:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683825.322061:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683825.322063:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.326314:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.326331:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b4c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.326360:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.326365:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.326372:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b4c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.326392:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b4c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.326403:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b4c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.326426:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b4c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.326448:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683825.326972:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.326979:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000519aaf5b/0xcf8485587b88b4c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.326989:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.326992:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.326996:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000519aaf5b/0xcf8485587b88b4c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327005:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000519aaf5b/0xcf8485587b88b4c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327014:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000519aaf5b/0xcf8485587b88b4c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327022:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000519aaf5b/0xcf8485587b88b4c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327037:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789683825.327295:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.327301:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076aa3071/0xcf8485587b88b4cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327315:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.327318:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.327322:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076aa3071/0xcf8485587b88b4cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327332:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076aa3071/0xcf8485587b88b4cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327354:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076aa3071/0xcf8485587b88b4cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327362:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076aa3071/0xcf8485587b88b4cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327435:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789683825.327698:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.327705:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b4d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327713:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.327716:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.327720:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b4d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327728:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b4d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327747:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b4d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.327754:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b4d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.329959:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789683825.329971:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b4c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.329984:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683825.329988:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b4c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330000:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b4c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330019:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b4c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330027:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b4c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330065:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789683825.330069:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000519aaf5b/0xcf8485587b88b4c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330076:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683825.330079:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000519aaf5b/0xcf8485587b88b4c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330086:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000519aaf5b/0xcf8485587b88b4c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330097:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000519aaf5b/0xcf8485587b88b4c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330104:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000519aaf5b/0xcf8485587b88b4c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330116:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683825.330120:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076aa3071/0xcf8485587b88b4cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330126:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683825.330129:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076aa3071/0xcf8485587b88b4cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330147:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076aa3071/0xcf8485587b88b4cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330157:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076aa3071/0xcf8485587b88b4cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330164:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076aa3071/0xcf8485587b88b4cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330176:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683825.330180:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b4d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330186:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683825.330189:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b4d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330197:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b4d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330207:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b4d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683825.330214:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683825.330215:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683825.330766:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.336515:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789683825.336529:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b4d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.336811:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.337155:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.337163:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b4dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337176:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.337180:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.337186:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b4dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337200:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b4dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337211:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b4dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337231:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b4dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337246:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683825.337357:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683825.337363:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b4dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337371:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.337375:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b4dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337385:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b4dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337402:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b4dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337409:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b4dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337424:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.337425:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.337427:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.337911:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.337924:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b4e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337933:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.337937:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.337941:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b4e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337950:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b4e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337958:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b4e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337965:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b4e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.337978:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683825.338070:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683825.338075:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b4e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.338082:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.338086:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b4e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.338094:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b4e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.338110:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b4e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.338117:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b4e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.338131:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.338133:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.338135:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.338533:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.338542:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.339953:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.339964:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc59ebff/0xcf8485587b88b4eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.339979:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.339984:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.339990:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc59ebff/0xcf8485587b88b4eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.340002:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc59ebff/0xcf8485587b88b4eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.340012:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc59ebff/0xcf8485587b88b4eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.340019:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc59ebff/0xcf8485587b88b4eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.340057:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683825.340136:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683825.340143:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc59ebff/0xcf8485587b88b4eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.340152:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.340157:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc59ebff/0xcf8485587b88b4eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.340174:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc59ebff/0xcf8485587b88b4eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.340191:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc59ebff/0xcf8485587b88b4eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.340199:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc59ebff/0xcf8485587b88b4eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.340220:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.340221:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.340223:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.345980:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.345992:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b4f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346009:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.346014:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.346020:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b4f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346035:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b4f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346044:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b4f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346053:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b4f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346076:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683825.346393:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.346399:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b4f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346408:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.346418:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.346422:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b4f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346433:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b4f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346440:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b4f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346447:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b4f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346466:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789683825.346477:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683825.346484:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b4f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346492:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.346497:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b4f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346506:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b4f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346522:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b4f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346542:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b4f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346563:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683825.346567:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b4f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346573:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.346576:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b4f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346584:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b4f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346595:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b4f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346603:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b4f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346615:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.346616:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.346618:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.346919:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.346926:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b500 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346941:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.346944:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.346949:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b500 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346959:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b500 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346967:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b500 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346974:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b500 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.346990:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683825.347244:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.347250:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b507 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347257:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.347260:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.347264:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b507 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347271:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b507 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347289:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b507 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347296:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b507 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347311:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789683825.347320:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683825.347325:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b500 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347331:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.347345:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b500 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347354:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b500 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347366:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b500 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347373:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b500 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347389:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683825.347399:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b507 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347406:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.347409:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b507 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347417:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b507 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347428:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b507 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347436:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b507 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.347450:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.347452:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.347453:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.347461:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.348389:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.350021:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.350035:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b50e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.350052:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.350057:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.350063:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b50e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.350089:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b50e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.350100:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b50e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.350108:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b50e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.350128:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683825.350140:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683825.350146:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b50e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.350153:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.350157:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b50e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.350166:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b50e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.350181:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b50e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.350188:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b50e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.350210:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.350211:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.350213:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.351461:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.351471:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b515 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.351485:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.351489:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.351495:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b515 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.351506:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b515 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.351516:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b515 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.351524:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b515 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.351542:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683825.351555:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683825.351560:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b515 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.351582:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.351587:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b515 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.351595:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b515 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.351610:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b515 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.351616:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b515 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.351633:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.351635:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.351637:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.353416:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.353428:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e41e4319/0xcf8485587b88b51c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.353443:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.353448:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.353454:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e41e4319/0xcf8485587b88b51c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.353467:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e41e4319/0xcf8485587b88b51c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.353486:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e41e4319/0xcf8485587b88b51c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.353494:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e41e4319/0xcf8485587b88b51c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.356613:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683825.356813:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683825.356823:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e41e4319/0xcf8485587b88b51c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.356838:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.356843:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e41e4319/0xcf8485587b88b51c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.356854:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e41e4319/0xcf8485587b88b51c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.356877:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e41e4319/0xcf8485587b88b51c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.356898:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e41e4319/0xcf8485587b88b51c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.356928:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.356930:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.356932:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789683825.363349:0:25091:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1789683825.363385:0:25091:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789683825.363393:0:25091:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789683825.363558:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23512:x1876618850343424:12345-0@lo:5:osp-pre-1-1.0 Request processed in 77507us (85593us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789683825.363570:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789683825.364079:0:23512:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789683825.364090:0:23512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23512:1876618850343424:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789683825.364107:0:23512:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1789683825.364167:0:23512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23512:1876618850343552:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789683825.364208:0:23512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683825.364244:0:23512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f84e2ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683825.365063:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850343552 00000100:00100000:2.0:1789683825.365073:0:22777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850343552 00000100:00100000:2.0:1789683825.365224:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683825.365234:0:22777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23512:x1876618850343552:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789683825.365308:0:22777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23512:x1876618850343552:12345-0@lo:900:osp-pre-1-1.0 Request processed in 75us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683825.365315:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789683825.365530:0:23512:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f2680 x1876618850343552/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789683841 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683825.365545:0:23512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23512:1876618850343552:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1789683825.366651:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.366662:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b523 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.366679:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.366684:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.366690:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b523 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.366704:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b523 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.366714:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b523 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.366721:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b523 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.366762:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683825.367149:0:22755:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683825.367157:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b523 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.367166:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.367171:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b523 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.367180:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b523 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.367198:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b523 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.367205:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b523 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.367224:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.367226:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.367227:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.367395:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.367401:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b52a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.367410:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.367413:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.367418:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b52a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.367427:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b52a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.367435:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b52a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.367443:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b52a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.367464:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683825.367726:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683825.367731:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b52a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.367740:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.367744:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b52a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.367752:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b52a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.367764:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b52a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.367771:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e51b7e/0xcf8485587b88b52a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.367972:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.367974:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.367976:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.370103:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.370116:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b531 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.370135:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.370148:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.370155:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b531 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.370170:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b531 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.370180:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b531 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.370189:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b531 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.370212:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683825.370695:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683825.370703:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b531 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.370713:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.370717:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b531 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.370738:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b531 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.370757:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b531 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.370764:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd3c2d39/0xcf8485587b88b531 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.370863:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.370866:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.370868:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.370969:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.370975:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b538 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.370984:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.370987:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.370992:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b538 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371001:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b538 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371010:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b538 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371023:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b538 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371046:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683825.371328:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.371345:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b53f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371354:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.371358:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.371362:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b53f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371373:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b53f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371380:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b53f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371388:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b53f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371409:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789683825.371417:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683825.371421:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b538 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371435:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.371439:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b538 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371447:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371460:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b538 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371467:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021075a7e/0xcf8485587b88b538 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371481:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683825.371484:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b53f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371490:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.371493:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b53f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371499:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b53f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371506:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b53f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371519:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7eedfc4/0xcf8485587b88b53f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.371531:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.371532:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.371534:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.374236:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.374251:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b546 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.374268:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.374273:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.374279:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b546 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.374292:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b546 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.374303:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b546 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.374310:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b546 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.374329:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683825.374754:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683825.374763:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b546 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.374773:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.374777:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b546 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.374815:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b546 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.374836:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b546 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.374856:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085502a5c/0xcf8485587b88b546 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.374879:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.374881:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.374883:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.374890:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.376179:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.376199:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b54d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.376211:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.376215:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.376220:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b54d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.376232:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b54d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.376241:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b54d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.376248:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b54d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.376306:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683825.379053:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.379069:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b554 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.379087:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.379091:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.379098:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b554 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.379111:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b554 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.379130:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b554 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.379139:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b554 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.379453:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683825.379462:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b54d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.379470:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.379476:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b54d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.379485:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b54d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.379504:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b54d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.379513:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032049e56/0xcf8485587b88b54d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.379533:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683825.379536:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b554 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.379551:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683825.379554:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b554 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.379562:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b554 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.379572:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b554 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683825.379580:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.379581:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683825.379584:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.380329:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789683825.380347:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b7c305f/0xcf8485587b88b554 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683825.380950:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.380957:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b55b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.380969:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.380973:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.380979:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b55b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.380993:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b55b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381003:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b55b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381021:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b55b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381044:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683825.381592:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.381598:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b98be66a/0xcf8485587b88b562 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381606:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.381609:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.381613:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b98be66a/0xcf8485587b88b562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381622:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b98be66a/0xcf8485587b88b562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381630:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b98be66a/0xcf8485587b88b562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381637:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b98be66a/0xcf8485587b88b562 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381654:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789683825.381665:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683825.381671:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b55b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381686:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.381692:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b55b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381702:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b55b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381719:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b55b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381726:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007902328e/0xcf8485587b88b55b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381744:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683825.381747:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b98be66a/0xcf8485587b88b562 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381754:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.381758:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b98be66a/0xcf8485587b88b562 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381765:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b98be66a/0xcf8485587b88b562 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381775:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b98be66a/0xcf8485587b88b562 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381889:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b98be66a/0xcf8485587b88b562 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.381904:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.381907:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.381909:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.382183:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.382189:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b297f126/0xcf8485587b88b569 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382197:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.382200:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.382205:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b297f126/0xcf8485587b88b569 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382214:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b297f126/0xcf8485587b88b569 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382281:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b297f126/0xcf8485587b88b569 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382291:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b297f126/0xcf8485587b88b569 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382307:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683825.382315:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683825.382325:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b297f126/0xcf8485587b88b569 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382332:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683825.382345:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b297f126/0xcf8485587b88b569 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382354:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b297f126/0xcf8485587b88b569 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382365:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b297f126/0xcf8485587b88b569 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382372:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b297f126/0xcf8485587b88b569 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382386:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.382388:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683825.382389:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683825.382653:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683825.382745:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683825.382751:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab5e354/0xcf8485587b88b570 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382760:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789683825.382763:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683825.382768:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab5e354/0xcf8485587b88b570 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382930:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab5e354/0xcf8485587b88b570 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382939:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab5e354/0xcf8485587b88b570 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382946:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab5e354/0xcf8485587b88b570 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683825.382967:0:24277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789683825.383001:0:24277:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1789683825.383095:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22793:x1876618850343168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 129337us (130774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683825.383106:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789683825.383396:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683825.383402:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab5e354/0xcf8485587b88b570 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683825.383410:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683825.383414:0:23923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab5e354/0xcf8485587b88b570 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683825.383431:0:23923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab5e354/0xcf8485587b88b570 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683825.383445:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab5e354/0xcf8485587b88b570 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683825.383452:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab5e354/0xcf8485587b88b570 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683825.383469:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683825.383471:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683825.383473:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683825.383569:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683825.383651:0:22793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d60a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22793:1876618850343168:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789683825.383668:0:22793:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1789683825.383714:0:22793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d60a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22793:1876618850343680:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789683825.383752:0:22793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683825.383908:0:22793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683825.392388:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850343680 00000100:00100000:0.0:1789683825.392404:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850343680 00000100:00100000:0.0:1789683825.392473:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789683825.392484:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22793:x1876618850343680:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789683825.392533:0:24279:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1789683825.397633:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22793:x1876618850343680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5145us (13874us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789683825.397645:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789683825.397708:0:22793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d60a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22793:1876618850343680:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789683825.397722:0:22793:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:2.0:1789683825.766310:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850343808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683825.766396:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683825.771977:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850343808 00000100:00100000:3.0:1789683825.772008:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850343808 00000100:00100000:3.0:1789683825.772338:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683825.772351:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850343808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683825.772388:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789683825.772475:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850343808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (6078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683825.772481:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683825.772538:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850343808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789683825.825585:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683826.862003:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683827.690608:0:25447:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789683827.813053:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683827.813076:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850343936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683827.813147:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683827.813427:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850343936 00000100:00100000:3.0:1789683827.813439:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850343936 00000100:00100000:3.0:1789683827.813533:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683827.813544:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850343936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789683827.813577:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789683827.813649:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850343936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683827.813657:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683827.813712:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850343936:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789683827.814639:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789683827.874218:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683828.318977:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789683828.319001:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850344064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683828.319112:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683828.319157:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850344192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683828.319180:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683828.319240:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850344064 00000100:00100000:1.0:1789683828.319249:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850344064 00000100:00100000:1.0:1789683828.319311:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850344192 00000100:00100000:1.0:1789683828.319314:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850344192 00000100:00100000:1.0:1789683828.319330:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789683828.319338:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850344064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683828.319375:0:23773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789683828.319437:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850344064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683828.319444:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789683828.319463:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789683828.319469:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850344192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683828.319484:0:23773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683828.319526:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850344192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683828.319532:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789683828.319576:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850344064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683828.319588:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850344192:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683828.895196:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789683829.157855:0:25500:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789683829.158187:0:25500:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1789683829.216386:0:23519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789683829.919663:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683830.370818:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850344576:0@lo:400:kworker.0 00000100:00100000:0.0:1789683830.370892:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683830.370937:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850345088:0@lo:400:kworker.0 00000100:00100000:0.0:1789683830.370992:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683830.371014:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850345600:0@lo:400:kworker.0 00000100:00100000:0.0:1789683830.371036:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683830.371052:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850346112:0@lo:400:kworker.0 00000100:00100000:0.0:1789683830.371071:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683830.371094:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789683830.371099:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850344704:0@lo:400:kworker.0 00000100:00100000:0.0:1789683830.371122:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683830.371138:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850345216:0@lo:400:kworker.0 00000100:00100000:0.0:1789683830.371155:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683830.371168:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850345728:0@lo:400:kworker.0 00000100:00100000:0.0:1789683830.371188:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683830.381568:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850345088 00000100:00100000:1.0:1789683830.381583:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850345088 00000100:00100000:1.0:1789683830.381678:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850345600 00000100:00100000:1.0:1789683830.381683:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850345600 00000100:00100000:1.0:1789683830.381695:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850346112 00000100:00100000:1.0:1789683830.381698:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850346112 00000100:00100000:1.0:1789683830.381735:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850345728 00000100:00100000:1.0:1789683830.381738:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850345728 00000100:00100000:1.0:1789683830.381758:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789683830.381767:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850345088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683830.381910:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850345088:12345-0@lo:400:kworker.0 Request processed in 144us (10927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683830.381918:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789683830.381938:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789683830.381943:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850345600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683830.381975:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850345600:12345-0@lo:400:kworker.0 Request processed in 32us (10938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683830.381980:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789683830.381992:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789683830.381998:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850346112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683830.382025:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850346112:12345-0@lo:400:kworker.0 Request processed in 28us (10952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683830.382030:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789683830.382043:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789683830.382049:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850345728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683830.382075:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850345728:12345-0@lo:400:kworker.0 Request processed in 27us (10887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683830.382081:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789683830.382109:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850344704 00000100:00100000:1.0:1789683830.382113:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850344704 00000100:00100000:1.0:1789683830.382145:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850345216 00000100:00100000:1.0:1789683830.382149:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850345216 00000100:00100000:1.0:1789683830.382162:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789683830.382167:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850344704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683830.382200:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850344704:12345-0@lo:400:kworker.0 Request processed in 33us (11077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683830.382215:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789683830.382227:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789683830.382233:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850345216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683830.382279:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850345216:12345-0@lo:400:kworker.0 Request processed in 46us (11122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683830.382294:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789683830.382343:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850344704:0@lo:400:kworker.0 00000100:00100000:1.0:1789683830.382355:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850345216:0@lo:400:kworker.0 00010000:00080000:1.0:1789683830.382369:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7246d80 x1876618850345728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683830.382378:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850345728:0@lo:400:kworker.0 00010000:00080000:1.0:1789683830.382388:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7244a80 x1876618850345088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683830.382397:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850345088:0@lo:400:kworker.0 00010000:00080000:1.0:1789683830.382407:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7245500 x1876618850345600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683830.382414:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850345600:0@lo:400:kworker.0 00010000:00080000:1.0:1789683830.382424:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db5500 x1876618850346112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683830.382431:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850346112:0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.382720:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850344320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683830.382810:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683830.382847:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850344832:0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.382872:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683830.382890:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850345344:0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.382909:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789683830.383254:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683830.383261:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683830.384187:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850345856:0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.384264:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683830.384309:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789683830.384317:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850344448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683830.384342:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683830.384360:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850345856 00000100:00100000:2.0:1789683830.384361:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850344960:0@lo:400:kworker.0 00000100:00100000:0.0:1789683830.384367:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850345856 00000100:00100000:2.0:1789683830.384379:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683830.384393:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850345472:0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.384410:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683830.384416:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789683830.384423:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850345856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.384424:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850345984:0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.384446:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683830.384606:0:22768:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789683830.384620:0:22768:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789683830.384718:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850345984 00000100:00100000:1.0:1789683830.384722:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850345984 00000100:00100000:1.0:1789683830.384760:0:22768:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789683830.384768:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789683830.384774:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850345984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683830.384899:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850344576 00000100:00100000:3.0:1789683830.384904:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850344576 00000100:00100000:3.0:1789683830.384933:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789683830.384939:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+24:3649:x1876618850344576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683830.384982:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+24:3649:x1876618850344576:12345-0@lo:400:kworker.0 Request processed in 43us (14089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683830.384989:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789683830.385020:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850344832 00000100:00100000:3.0:1789683830.385024:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850344832 00000100:00100000:3.0:1789683830.385044:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850345344 00000100:00100000:3.0:1789683830.385047:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850345344 00000100:00100000:3.0:1789683830.385057:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850344960 00000100:00100000:3.0:1789683830.385060:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850344960 00000100:00100000:3.0:1789683830.385071:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850345472 00000100:00100000:3.0:1789683830.385073:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850345472 00000100:00100000:3.0:1789683830.385087:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683830.385093:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850344832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683830.392750:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850345856:12345-0@lo:400:kworker.0 Request processed in 8318us (8476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683830.392764:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1789683830.392847:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683830.392853:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683830.392856:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683830.392858:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683830.395525:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850345984:12345-0@lo:400:kworker.0 Request processed in 10741us (11068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683830.395541:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789683830.395884:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850344320 00000100:00100000:2.0:1789683830.395894:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850344320 00000100:00100000:2.0:1789683830.395932:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850344448 00000100:00100000:2.0:1789683830.395935:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850344448 00000100:00100000:2.0:1789683830.395948:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683830.395956:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876618850344320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683830.396023:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789683830.396096:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876618850344320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (13286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683830.396103:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683830.396119:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683830.396125:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876618850344448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789683830.396136:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789683830.396161:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876618850344448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (11818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683830.396166:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683830.396202:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683830.396210:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850345344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.396255:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850345344:12345-0@lo:400:kworker.0 Request processed in 35us (13334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683830.396262:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683830.396279:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683830.396896:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850344832:12345-0@lo:400:kworker.0 Request processed in 11800us (14020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683830.396906:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683830.396933:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683830.396940:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850345472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683830.396976:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850345472:12345-0@lo:400:kworker.0 Request processed in 37us (12565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683830.396981:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683830.397039:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850344576:0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.397260:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876618850344960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.397774:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876618850344960:12345-0@lo:400:kworker.0 Request processed in 1488us (13393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683830.397965:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683830.398030:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850344448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683830.398044:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850344960:0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.398054:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850345472:0@lo:400:kworker.0 00010000:00080000:2.0:1789683830.398066:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db5f80 x1876618850345984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683830.398076:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850345984:0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.398088:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850344320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683830.398099:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850344832:0@lo:400:kworker.0 00000100:00100000:2.0:1789683830.398109:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850345344:0@lo:400:kworker.0 00010000:00080000:2.0:1789683830.398119:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db4a80 x1876618850345856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683830.398128:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850345856:0@lo:400:kworker.0 00000020:00000004:3.0:1789683830.638728:0:25551:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683830.638989:0:25551:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789683830.879692:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683830.879722:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850346240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683830.879826:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683830.879916:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850346240 00000100:00100000:2.0:1789683830.879926:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850346240 00000100:00100000:2.0:1789683830.879983:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683830.879992:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850346240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683830.880023:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683830.880073:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850346240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683830.880080:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683830.880126:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850346240:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789683830.883011:0:25091:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:0.0:1789683830.942946:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683830.987914:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683830.988136:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835545088 00000100:00100000:3.0:1789683830.988145:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835545088 00000100:00100000:3.0:1789683830.988196:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 118 00000100:00100000:3.0:1789683830.988204:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2401:x1876618835545088:12345-192.168.201.50@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789683830.988249:0:22760:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 04575703-9878-47d6-810f-62226c59585b@192.168.201.50@tcp t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:3.0:1789683830.988283:0:22760:0:(genops.c:1384:class_connect()) connect: client 04575703-9878-47d6-810f-62226c59585b, cookie 0xcf8485587b88b577 00000100:00080000:3.0:1789683830.988416:0:22760:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d19000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683830.988507:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+5:2401:x1876618835545088:12345-192.168.201.50@tcp:250:mount.lustre.0 Request processed in 301us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683830.988516:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 118 00000100:00100000:0.0:1789683830.994582:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683830.994672:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835545216 00000100:00100000:3.0:1789683830.994681:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835545216 00000100:00100000:3.0:1789683830.994750:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:3.0:1789683830.994760:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+5:18091:x1876618835545216:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683830.994779:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683830.994823:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e845c2a00/0xcf8485587b88b57e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcae6 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683830.994870:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e845c2a00/0xcf8485587b88b57e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcae6 expref: 6 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683830.994884:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e845c2a00/0xcf8485587b88b57e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcae6 expref: 6 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683830.994893:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c2a00, rc 0) 00000100:00100000:3.0:1789683830.994956:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+6:18091:x1876618835545216:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 197us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683830.994963:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:1.0:1789683830.996988:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683830.997082:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835545344 00000100:00100000:0.0:1789683830.997091:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835545344 00000100:00100000:0.0:1789683830.997143:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:0.0:1789683830.997152:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8f78f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+6:18091:x1876618835545344:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789683830.997282:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8f78f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+6:18091:x1876618835545344:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 131us (302us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789683830.997291:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:2.0:1789683830.999840:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683830.999973:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835545472 00000100:00100000:0.0:1789683830.999983:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835545472 00000100:00100000:0.0:1789683831.000039:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:0.0:1789683831.000050:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8f78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+6:18091:x1876618835545472:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789683831.000067:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683831.000085:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b585 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcaed expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.000113:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaed expref: 7 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.000127:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88b585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaed expref: 7 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.000151:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c800, rc 0) 00000100:00100000:0.0:1789683831.000215:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8f78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+7:18091:x1876618835545472:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 167us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683831.000222:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:2.0:1789683831.014749:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683831.014854:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835545600 00000100:00100000:3.0:1789683831.014865:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835545600 00000100:00100000:3.0:1789683831.014922:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 122 00000100:00100000:3.0:1789683831.014932:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+7:18091:x1876618835545600:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789683831.015103:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+8:18091:x1876618835545600:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 171us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683831.015111:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 122 00000100:00100000:1.0:1789683831.018259:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683831.018356:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835545728 00000100:00100000:3.0:1789683831.018367:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835545728 00000100:00100000:3.0:1789683831.018422:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 123 00000100:00100000:3.0:1789683831.018432:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+8:18091:x1876618835545728:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789683831.018593:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+8:18091:x1876618835545728:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 161us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683831.018601:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 123 00000100:00100000:2.0:1789683831.039022:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683831.039288:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835545856 00000100:00100000:0.0:1789683831.039298:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835545856 00000100:00100000:0.0:1789683831.039349:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00100000:0.0:1789683831.039358:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+8:18109:x1876618835545856:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683831.039507:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+8:18109:x1876618835545856:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 148us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683831.039515:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00100000:2.0:1789683831.070914:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683831.071070:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835545984 00000100:00100000:1.0:1789683831.071082:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835545984 00000100:00100000:1.0:1789683831.071153:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:1.0:1789683831.071163:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+8:18109:x1876618835545984:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789683831.071330:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+8:18109:x1876618835545984:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 167us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683831.071338:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:1.0:1789683831.091572:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683831.091869:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835546112 00000100:00100000:3.0:1789683831.091891:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835546112 00000100:00100000:3.0:1789683831.091942:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:3.0:1789683831.091952:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+8:18109:x1876618835546112:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683831.092105:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+8:18109:x1876618835546112:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 154us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683831.092113:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:2.0:1789683831.094723:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683831.094883:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835546240 00000100:00100000:3.0:1789683831.094894:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835546240 00000100:00100000:3.0:1789683831.094958:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:3.0:1789683831.094969:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8aaa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+8:18091:x1876618835546240:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683831.094987:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683831.095006:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e845c3c00/0xcf8485587b88b58c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcb1e expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683831.095036:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e845c3c00/0xcf8485587b88b58c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb1e expref: 9 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683831.095047:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e845c3c00/0xcf8485587b88b58c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb1e expref: 9 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683831.095057:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c3c00, rc 0) 00000100:00100000:3.0:1789683831.095121:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8aaa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+9:18091:x1876618835546240:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 153us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683831.095128:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:2.0:1789683831.105093:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683831.105299:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835546368 00000100:00100000:1.0:1789683831.105310:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835546368 00000100:00100000:1.0:1789683831.105369:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:1.0:1789683831.105381:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+9:18091:x1876618835546368:12345-192.168.201.50@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789683831.105413:0:22761:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789683831.105444:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789683831.105448:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789683831.105671:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789683831.105675:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789683831.105678:0:22761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789683831.111949:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+9:18091:x1876618835546368:12345-192.168.201.50@tcp:256:mount.lustre.0 Request processed in 6558us (6854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683831.111965:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:2.0:1789683831.118333:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683831.118551:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835546496 00000100:00100000:0.0:1789683831.118561:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835546496 00000100:00100000:0.0:1789683831.118620:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:0.0:1789683831.118631:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+9:18091:x1876618835546496:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789683831.118649:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683831.118667:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88b593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcb25 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.118703:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88b593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb25 expref: 10 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.118715:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88b593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb25 expref: 10 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.118725:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c600, rc 0) 00000100:00100000:0.0:1789683831.118837:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+10:18091:x1876618835546496:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 207us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683831.118844:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:0.0:1789683831.121705:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683831.121819:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835546624 00000100:00100000:2.0:1789683831.121829:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835546624 00000100:00100000:2.0:1789683831.121881:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:2.0:1789683831.121892:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+10:18091:x1876618835546624:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789683831.122056:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+10:18091:x1876618835546624:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 164us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683831.122079:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:1.0:1789683831.125669:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683831.126039:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835546752 00000100:00100000:3.0:1789683831.126049:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835546752 00000100:00100000:3.0:1789683831.126108:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:3.0:1789683831.126119:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb619c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+10:18091:x1876618835546752:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789683831.126304:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb619c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+10:18091:x1876618835546752:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 186us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683831.126313:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:3.0:1789683831.135646:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683831.135949:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835546880 00000100:00100000:0.0:1789683831.135960:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835546880 00000100:00100000:0.0:1789683831.136017:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 132 00000100:00100000:0.0:1789683831.136028:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+10:18115:x1876618835546880:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683831.136184:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+10:18115:x1876618835546880:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 158us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683831.136192:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 132 00000100:00100000:0.0:1789683831.147908:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683831.148008:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835547008 00000100:00100000:2.0:1789683831.148019:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835547008 00000100:00100000:2.0:1789683831.148073:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 133 00000100:00100000:2.0:1789683831.148082:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+10:18115:x1876618835547008:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683831.148246:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+10:18115:x1876618835547008:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 164us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683831.148254:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 133 00000100:00100000:1.0:1789683831.161481:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683831.161580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683831.161734:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835547136 00000100:00100000:2.0:1789683831.161743:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835547136 00000100:00100000:2.0:1789683831.161812:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835547392 00000100:00100000:2.0:1789683831.161816:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835547392 00000100:00100000:2.0:1789683831.161848:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:2.0:1789683831.161856:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1876618835547136:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789683831.161887:0:25531:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c6dee52e-fd7e-4613-b7b8-6beab7d04952@192.168.201.50@tcp t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:2.0:1789683831.161943:0:25531:0:(genops.c:1384:class_connect()) connect: client c6dee52e-fd7e-4613-b7b8-6beab7d04952, cookie 0xcf8485587b88b59a 00000004:00100000:2.0:1789683831.161985:0:25531:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1789683831.162242:0:25531:0:(import.c:65:import_set_state_nolock()) ffff9f0e8450f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683831.162330:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:2401:x1876618835547136:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 471us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683831.162339:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:2.0:1789683831.162360:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:2.0:1789683831.162365:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1876618835547392:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789683831.162381:0:25531:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from c6dee52e-fd7e-4613-b7b8-6beab7d04952@192.168.201.50@tcp t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:2.0:1789683831.162420:0:25531:0:(genops.c:1384:class_connect()) connect: client c6dee52e-fd7e-4613-b7b8-6beab7d04952, cookie 0xcf8485587b88b5a1 00000004:00100000:2.0:1789683831.162433:0:25531:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1789683831.162582:0:25531:0:(import.c:65:import_set_state_nolock()) ffff9f0e8450e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683831.162608:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:2401:x1876618835547392:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 242us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683831.162615:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:3.0:1789683831.180510:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683831.181369:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683831.181450:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683831.181920:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835547648 00000100:00100000:3.0:1789683831.181931:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835547648 00000100:00100000:3.0:1789683831.182009:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835547520 00000100:00100000:3.0:1789683831.182012:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835547520 00000100:00100000:3.0:1789683831.182026:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835547264 00000100:00100000:3.0:1789683831.182028:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835547264 00000100:00100000:3.0:1789683831.182043:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:3.0:1789683831.182053:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:18091:x1876618835547648:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789683831.182092:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789683831.182186:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:18091:x1876618835547648:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 133us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683831.182194:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:3.0:1789683831.182211:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:3.0:1789683831.182218:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:0:x1876618835547520:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789683831.182379:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789683831.182443:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:0:x1876618835547520:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 225us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683831.182450:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:3.0:1789683831.182465:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:3.0:1789683831.182472:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:0:x1876618835547264:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789683831.182492:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789683831.182593:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:0:x1876618835547264:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 45us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683831.182601:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00080000:1.0:1789683831.182703:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683831.182707:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683831.189642:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683831.189860:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835547776 00000100:00100000:1.0:1789683831.189871:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835547776 00000100:00100000:1.0:1789683831.189933:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:1.0:1789683831.189943:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18091:x1876618835547776:12345-192.168.201.50@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789683831.190052:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18091:x1876618835547776:12345-192.168.201.50@tcp:40:mount.lustre.0 Request processed in 111us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683831.190059:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:0.0:1789683831.198268:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683831.198358:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683831.198391:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683831.198510:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835548160 00000100:00100000:2.0:1789683831.198529:0:22777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835548160 00000100:00100000:2.0:1789683831.198602:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:2.0:1789683831.198613:0:22777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18091:x1876618835548160:12345-192.168.201.50@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789683831.198708:0:22777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18091:x1876618835548160:12345-192.168.201.50@tcp:900:mount.lustre.0 Request processed in 98us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683831.198716:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:3.0:1789683831.199023:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835547904 00000100:00100000:3.0:1789683831.199028:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835547904 00000100:00100000:3.0:1789683831.199056:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835548032 00000100:00100000:3.0:1789683831.199059:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835548032 00000100:00100000:3.0:1789683831.199075:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:3.0:1789683831.199080:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1876618835547904:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789683831.199107:0:24277:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c6dee52e-fd7e-4613-b7b8-6beab7d04952@192.168.201.50@tcp t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:3.0:1789683831.199141:0:24277:0:(genops.c:1384:class_connect()) connect: client c6dee52e-fd7e-4613-b7b8-6beab7d04952, cookie 0xcf8485587b88b5a8 00002000:00100000:3.0:1789683831.199153:0:24277:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c6dee52e-fd7e-4613-b7b8-6beab7d04952/ffff9f0e83d1d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789683831.199165:0:24277:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1789683831.199352:0:24277:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789683831.199382:0:24277:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d1b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683831.199441:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:2401:x1876618835547904:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 358us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683831.199459:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:3.0:1789683831.199477:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:3.0:1789683831.199481:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1876618835548032:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789683831.199498:0:24277:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c6dee52e-fd7e-4613-b7b8-6beab7d04952@192.168.201.50@tcp t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:3.0:1789683831.199623:0:24277:0:(genops.c:1384:class_connect()) connect: client c6dee52e-fd7e-4613-b7b8-6beab7d04952, cookie 0xcf8485587b88b5af 00002000:00100000:3.0:1789683831.199630:0:24277:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c6dee52e-fd7e-4613-b7b8-6beab7d04952/ffff9f0e83d1a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789683831.199642:0:24277:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1789683831.199942:0:24277:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789683831.199960:0:24277:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d19800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683831.199990:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:2401:x1876618835548032:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 506us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683831.199996:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:2.0:1789683831.214004:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683831.217491:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835548288 00000100:00100000:3.0:1789683831.217508:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835548288 00000100:00100000:3.0:1789683831.217590:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789683831.217601:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18091:x1876618835548288:12345-192.168.201.50@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789683831.223397:0:22769:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5683us 00000004:00200000:3.0:1789683831.246679:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789683831.246834:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18091:x1876618835548288:12345-192.168.201.50@tcp:33:mount.lustre.0 Request processed in 29228us (32834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683831.246845:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789683831.494455:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683831.494624:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835548416 00000100:00100000:0.0:1789683831.494636:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835548416 00000100:00100000:0.0:1789683831.494714:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:0.0:1789683831.494724:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18138:x1876618835548416:12345-192.168.201.50@tcp:101:mkdir.0 00010000:00010000:0.0:1789683831.494747:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683831.494778:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b88b5b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcb56 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.494873:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88b5bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.494887:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88b5bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.494918:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88b5bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683831.494970:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789683831.494974:0:22766:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683831.495010:0:22766:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88b5bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.495036:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b88b5b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb56 expref: 8 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.495054:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88b5bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb56 expref: 7 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683831.495062:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:0.0:1789683831.495066:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683831.495069:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454da00, rc 0) 00000100:00100000:0.0:1789683831.495137:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:18138:x1876618835548416:12345-192.168.201.50@tcp:101:mkdir.0 Request processed in 414us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683831.495144:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00010000:00010000:0.0:1789683831.967009:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683832.671891:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789683832.927184:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850346368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683832.927281:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683832.927376:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850346368 00000100:00100000:1.0:1789683832.927385:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850346368 00000100:00100000:1.0:1789683832.927461:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683832.927471:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850346368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683832.927502:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789683832.927551:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850346368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683832.927558:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789683832.927648:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683832.927692:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850346368:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789683832.990968:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683833.439490:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683833.439516:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850346496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683833.439588:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683833.439833:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850346496 00000100:00100000:1.0:1789683833.439842:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850346496 00000100:00100000:1.0:1789683833.439898:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789683833.439909:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850346496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683833.439944:0:23773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683833.440000:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850346496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683833.440007:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789683833.440383:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683833.440395:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850346624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683833.440427:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683833.440468:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850346624 00000100:00100000:3.0:1789683833.440481:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850346624 00000100:00100000:3.0:1789683833.440523:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683833.440530:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850346624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683833.440550:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789683833.440588:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850346624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683833.440594:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683833.440635:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850346624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683833.440940:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850346496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683833.891770:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683833.891964:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835548544 00000100:00100000:1.0:1789683833.891974:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835548544 00000100:00100000:1.0:1789683833.892054:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:1.0:1789683833.892065:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:18191:x1876618835548544:12345-192.168.201.50@tcp:41:lfs.0 00000004:00000024:1.0:1789683833.892113:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789683833.892208:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:18191:x1876618835548544:12345-192.168.201.50@tcp:41:lfs.0 Request processed in 145us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683833.892215:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00080000:2.0:1789683833.892629:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683833.895876:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683833.896745:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835548672 00000100:00100000:0.0:1789683833.896757:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835548672 00000100:00100000:0.0:1789683833.896865:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:0.0:1789683833.896877:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18191:x1876618835548672:12345-192.168.201.50@tcp:41:lfs.0 00000004:00000024:0.0:1789683833.896910:0:22766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789683833.897006:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18191:x1876618835548672:12345-192.168.201.50@tcp:41:lfs.0 Request processed in 131us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683833.897014:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00080000:2.0:1789683833.897082:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683833.908353:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683833.908477:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835548800 00000100:00100000:2.0:1789683833.908487:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835548800 00000100:00100000:2.0:1789683833.908565:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:2.0:1789683833.908576:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18191:x1876618835548800:12345-192.168.201.50@tcp:13:lfs.0 00002000:00000024:2.0:1789683833.908602:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683833.908691:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18191:x1876618835548800:12345-192.168.201.50@tcp:13:lfs.0 Request processed in 116us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683833.908711:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00080000:3.0:1789683833.908817:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683833.913172:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683833.913717:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835548928 00000100:00100000:2.0:1789683833.913728:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835548928 00000100:00100000:2.0:1789683833.913862:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:2.0:1789683833.913875:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18191:x1876618835548928:12345-192.168.201.50@tcp:13:lfs.0 00002000:00000024:2.0:1789683833.913921:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789683833.914017:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18191:x1876618835548928:12345-192.168.201.50@tcp:13:lfs.0 Request processed in 144us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683833.914025:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00080000:3.0:1789683833.916720:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789683834.018290:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683834.167149:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683834.167359:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835549056 00000100:00100000:3.0:1789683834.167374:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835549056 00000100:00100000:3.0:1789683834.167462:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:3.0:1789683834.167485:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+10:18224:x1876618835549056:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683834.167515:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683834.167545:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e845c3000/0xcf8485587b88b5c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcb5d expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.167592:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e845c3000/0xcf8485587b88b5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb5d expref: 11 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.167611:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e845c3000/0xcf8485587b88b5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb5d expref: 11 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.167628:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c3000, rc 0) 00000100:00100000:3.0:1789683834.167698:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+11:18224:x1876618835549056:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 220us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683834.167706:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:0.0:1789683834.184585:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683834.184726:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835549184 00000100:00100000:3.0:1789683834.184736:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835549184 00000100:00100000:3.0:1789683834.184832:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:3.0:1789683834.184842:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+11:18224:x1876618835549184:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789683834.185000:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+11:18224:x1876618835549184:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 158us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683834.185007:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:1.0:1789683834.194059:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683834.194264:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835549312 00000100:00100000:3.0:1789683834.194275:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835549312 00000100:00100000:3.0:1789683834.194339:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:3.0:1789683834.194358:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+11:18224:x1876618835549312:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789683834.194508:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+11:18224:x1876618835549312:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 151us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683834.194516:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:1.0:1789683834.202012:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683834.202112:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835549440 00000100:00100000:0.0:1789683834.202122:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835549440 00000100:00100000:0.0:1789683834.202186:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:0.0:1789683834.202196:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+11:18230:x1876618835549440:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683834.202342:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+11:18230:x1876618835549440:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 146us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683834.202350:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:1.0:1789683834.228572:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683834.228780:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835549568 00000100:00100000:0.0:1789683834.228816:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835549568 00000100:00100000:0.0:1789683834.228873:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:0.0:1789683834.228884:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+11:18230:x1876618835549568:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683834.229035:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+11:18230:x1876618835549568:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 152us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683834.229043:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:1.0:1789683834.249290:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683834.249398:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835549696 00000100:00100000:3.0:1789683834.249409:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835549696 00000100:00100000:3.0:1789683834.249471:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 139 00000100:00100000:3.0:1789683834.249481:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+11:18230:x1876618835549696:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683834.249661:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+11:18230:x1876618835549696:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 180us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683834.249669:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 139 00000100:00100000:1.0:1789683834.254678:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683834.254823:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835549824 00000100:00100000:3.0:1789683834.254835:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835549824 00000100:00100000:3.0:1789683834.254894:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 140 00000100:00100000:3.0:1789683834.254904:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+11:18224:x1876618835549824:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683834.254936:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683834.254954:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e845c2800/0xcf8485587b88b5cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcb8e expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.254983:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e845c2800/0xcf8485587b88b5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb8e expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.254997:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e845c2800/0xcf8485587b88b5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb8e expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.255007:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c2800, rc 0) 00000100:00100000:3.0:1789683834.255064:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+12:18224:x1876618835549824:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 161us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683834.255070:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 140 00000100:00100000:1.0:1789683834.261137:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683834.261258:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835549952 00000100:00100000:0.0:1789683834.261280:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835549952 00000100:00100000:0.0:1789683834.261338:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 141 00000100:00100000:0.0:1789683834.261349:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+12:18224:x1876618835549952:12345-192.168.201.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789683834.261378:0:22759:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789683834.261396:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789683834.261400:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789683834.261403:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789683834.261406:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789683834.261408:0:22759:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789683834.272471:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+12:18224:x1876618835549952:12345-192.168.201.50@tcp:256:mount.lustre.0 Request processed in 11113us (11332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683834.272486:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 141 00000100:00100000:1.0:1789683834.282051:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683834.282096:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835550080 00000100:00100000:2.0:1789683834.282105:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835550080 00000100:00100000:2.0:1789683834.282213:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00100000:2.0:1789683834.282367:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+12:18224:x1876618835550080:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789683834.282387:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683834.282407:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b5d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcb95 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683834.282439:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b5d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb95 expref: 13 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683834.282585:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b5d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb95 expref: 13 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683834.282596:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31400, rc 0) 00000100:00100000:2.0:1789683834.282656:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+13:18224:x1876618835550080:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 434us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683834.282664:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00100000:2.0:1789683834.284833:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683834.285019:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835550208 00000100:00100000:0.0:1789683834.285028:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835550208 00000100:00100000:0.0:1789683834.285082:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 143 00000100:00100000:0.0:1789683834.285092:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+13:18224:x1876618835550208:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789683834.285360:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+13:18224:x1876618835550208:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 267us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683834.285369:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 143 00000100:00100000:1.0:1789683834.288288:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683834.288585:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835550336 00000100:00100000:2.0:1789683834.288596:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835550336 00000100:00100000:2.0:1789683834.288658:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 144 00000100:00100000:2.0:1789683834.288668:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+13:18224:x1876618835550336:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789683834.288817:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+13:18224:x1876618835550336:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 149us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683834.288825:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 144 00000100:00100000:1.0:1789683834.291656:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683834.291850:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835550464 00000100:00100000:3.0:1789683834.291860:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835550464 00000100:00100000:3.0:1789683834.292058:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:3.0:1789683834.292067:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9dd2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+13:18234:x1876618835550464:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683834.292212:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9dd2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+13:18234:x1876618835550464:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 145us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683834.292220:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:0.0:1789683834.306219:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683834.310275:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835550592 00000100:00100000:2.0:1789683834.310290:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835550592 00000100:00100000:2.0:1789683834.310374:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 146 00000100:00100000:2.0:1789683834.310385:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+13:18234:x1876618835550592:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683834.310567:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+13:18234:x1876618835550592:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 182us (4356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683834.310576:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 146 00000100:00100000:0.0:1789683834.324478:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683834.324526:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683834.324849:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835550720 00000100:00100000:1.0:1789683834.324859:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835550720 00000100:00100000:1.0:1789683834.324902:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835550976 00000100:00100000:1.0:1789683834.324906:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835550976 00000100:00100000:1.0:1789683834.324928:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:1.0:1789683834.324936:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1876618835550720:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789683834.324967:0:22768:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c@192.168.201.50@tcp t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:1.0:1789683834.325005:0:22768:0:(genops.c:1384:class_connect()) connect: client a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c, cookie 0xcf8485587b88b5d9 00000004:00100000:1.0:1789683834.325030:0:22768:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1789683834.325122:0:22768:0:(import.c:65:import_set_state_nolock()) ffff9f0e83e97800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683834.325197:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:2401:x1876618835550720:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 260us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683834.325205:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:1.0:1789683834.325234:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:1.0:1789683834.325240:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1876618835550976:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789683834.325255:0:22768:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c@192.168.201.50@tcp t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:1.0:1789683834.325275:0:22768:0:(genops.c:1384:class_connect()) connect: client a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c, cookie 0xcf8485587b88b5e0 00000004:00100000:1.0:1789683834.325287:0:22768:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1789683834.325331:0:22768:0:(import.c:65:import_set_state_nolock()) ffff9f0e83e94000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683834.325358:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:2401:x1876618835550976:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 116us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683834.325365:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:1.0:1789683834.329564:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683834.329821:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835551104 00000100:00100000:3.0:1789683834.329833:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835551104 00000100:00100000:3.0:1789683834.329904:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:3.0:1789683834.329916:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:0:x1876618835551104:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789683834.329956:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789683834.330041:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:0:x1876618835551104:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 128us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683834.330049:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00080000:2.0:1789683834.330621:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683834.333172:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683834.333234:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683834.333365:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835550848 00000100:00100000:1.0:1789683834.333375:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835550848 00000100:00080000:3.0:1789683834.333550:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683834.333734:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835551232 00000100:00100000:1.0:1789683834.333739:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835551232 00000100:00100000:1.0:1789683834.333775:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:1.0:1789683834.333815:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+7:0:x1876618835550848:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789683834.333854:0:22766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789683834.333924:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+7:0:x1876618835550848:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 141us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683834.333931:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:1.0:1789683834.333949:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:1.0:1789683834.333956:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:18224:x1876618835551232:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789683834.333966:0:22766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789683834.333985:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:18224:x1876618835551232:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 30us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683834.333991:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:0.0:1789683834.336212:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683834.336398:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835551360 00000100:00100000:1.0:1789683834.336408:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835551360 00000100:00100000:1.0:1789683834.336473:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789683834.336483:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:18224:x1876618835551360:12345-192.168.201.50@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789683834.336563:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:18224:x1876618835551360:12345-192.168.201.50@tcp:40:mount.lustre.0 Request processed in 82us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683834.336571:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789683834.340843:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683834.340882:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683834.340912:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683834.340987:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835551744 00000100:00100000:2.0:1789683834.340998:0:22777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835551744 00000100:00100000:2.0:1789683834.341060:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:2.0:1789683834.341071:0:22777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:18224:x1876618835551744:12345-192.168.201.50@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789683834.341150:0:22777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:18224:x1876618835551744:12345-192.168.201.50@tcp:900:mount.lustre.0 Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683834.341158:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:0.0:1789683834.341586:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835551488 00000100:00100000:0.0:1789683834.341601:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835551488 00000100:00100000:0.0:1789683834.341748:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835551616 00000100:00100000:0.0:1789683834.341753:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835551616 00000100:00100000:0.0:1789683834.341772:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:0.0:1789683834.341778:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1876618835551488:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789683834.341835:0:24278:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c@192.168.201.50@tcp t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:0.0:1789683834.341869:0:24278:0:(genops.c:1384:class_connect()) connect: client a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c, cookie 0xcf8485587b88b5e7 00002000:00100000:0.0:1789683834.341881:0:24278:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c/ffff9f0f85575000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789683834.341900:0:24278:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789683834.341961:0:24278:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789683834.341989:0:24278:0:(import.c:65:import_set_state_nolock()) ffff9f0e825e5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683834.342032:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:2401:x1876618835551488:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 253us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683834.342038:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:0.0:1789683834.342053:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:0.0:1789683834.342056:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1876618835551616:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789683834.342072:0:24278:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c@192.168.201.50@tcp t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:0.0:1789683834.342088:0:24278:0:(genops.c:1384:class_connect()) connect: client a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c, cookie 0xcf8485587b88b5ee 00002000:00100000:0.0:1789683834.342094:0:24278:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c/ffff9f0e825e1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789683834.342100:0:24278:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789683834.342132:0:24278:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789683834.342146:0:24278:0:(import.c:65:import_set_state_nolock()) ffff9f0e825e3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683834.342170:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:2401:x1876618835551616:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 111us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683834.342187:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:1.0:1789683834.344334:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683834.344426:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835551872 00000100:00100000:3.0:1789683834.344437:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835551872 00000100:00100000:3.0:1789683834.344500:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:3.0:1789683834.344511:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:18224:x1876618835551872:12345-192.168.201.50@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789683834.344761:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789683834.344889:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:18224:x1876618835551872:12345-192.168.201.50@tcp:33:mount.lustre.0 Request processed in 380us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683834.344897:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:2.0:1789683834.545014:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683834.545119:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835552000 00000100:00100000:3.0:1789683834.545129:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835552000 00000100:00100000:3.0:1789683834.545197:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789683834.545207:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:18257:x1876618835552000:12345-192.168.201.50@tcp:101:mkdir.0 00010000:00010000:3.0:1789683834.545227:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683834.545252:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3400/0xcf8485587b88b5f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcbc6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.545316:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.545331:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.545344:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683834.545406:0:22767:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789683834.545410:0:22767:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683834.545430:0:22767:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.545466:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3400/0xcf8485587b88b5f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbc6 expref: 8 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.545486:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbc6 expref: 7 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683834.545495:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:3.0:1789683834.545498:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683834.545501:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c2e00, rc 0) 00000100:00100000:3.0:1789683834.545566:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+7:18257:x1876618835552000:12345-192.168.201.50@tcp:101:mkdir.0 Request processed in 360us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683834.545573:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00010000:00010000:0.0:1789683835.041252:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683835.488230:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850346752:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488302:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488342:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850347264:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488366:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488380:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850347776:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488397:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488410:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850348288:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488428:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488461:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789683835.488466:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850347136:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488486:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488498:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850347648:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488516:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488527:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850348160:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488544:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488742:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850347008:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488766:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488804:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850347520:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488820:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488833:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850348032:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488847:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488857:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789683835.488874:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850346880:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488893:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488905:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850347392:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488920:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850347904:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.488946:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683835.488966:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850347136 00000100:00100000:3.0:1789683835.488973:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850347136 00000100:00100000:3.0:1789683835.489014:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850347648 00000100:00100000:3.0:1789683835.489082:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850347648 00000100:00100000:3.0:1789683835.489100:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850347008 00000100:00100000:3.0:1789683835.489102:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850347008 00000100:00100000:3.0:1789683835.489120:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850347520 00000100:00100000:3.0:1789683835.489123:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850347520 00000100:00100000:3.0:1789683835.489135:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683835.489142:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850347136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.489206:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850347136:12345-0@lo:400:kworker.0 Request processed in 63us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.489213:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683835.489229:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683835.489235:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850347648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.489261:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850347648:12345-0@lo:400:kworker.0 Request processed in 26us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.489266:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683835.489277:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683835.489282:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850347008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.489310:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850347008:12345-0@lo:400:kworker.0 Request processed in 28us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.489316:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683835.489327:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683835.489333:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850347520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.489358:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850347520:12345-0@lo:400:kworker.0 Request processed in 27us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.489363:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683835.489388:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850346880 00000100:00100000:3.0:1789683835.489391:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850346880 00000100:00100000:3.0:1789683835.489410:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850347392 00000100:00100000:3.0:1789683835.489412:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850347392 00000100:00100000:3.0:1789683835.489424:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789683835.489437:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850346880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.489469:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850346880:12345-0@lo:400:kworker.0 Request processed in 33us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.489474:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789683835.489485:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683835.489490:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850347392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.489513:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850347392:12345-0@lo:400:kworker.0 Request processed in 24us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.489518:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789683835.489534:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683835.489537:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683835.489552:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850347264 00000100:00100000:3.0:1789683835.489901:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850347264 00000100:00100000:3.0:1789683835.489927:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850347776 00000100:00100000:3.0:1789683835.489930:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850347776 00000100:00100000:3.0:1789683835.489940:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850348288 00000100:00100000:3.0:1789683835.489942:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850348288 00000100:00100000:3.0:1789683835.489955:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850348160 00000100:00100000:3.0:1789683835.489958:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850348160 00000100:00100000:3.0:1789683835.489966:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850348032 00000100:00100000:3.0:1789683835.489968:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850348032 00000100:00100000:3.0:1789683835.489978:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850347904 00000100:00100000:3.0:1789683835.489980:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850347904 00000100:00100000:3.0:1789683835.489992:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683835.489997:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850347264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.490664:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850347264:12345-0@lo:400:kworker.0 Request processed in 663us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.490673:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683835.490693:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683835.490714:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850347776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.490748:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850347776:12345-0@lo:400:kworker.0 Request processed in 37us (2350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.490753:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683835.490765:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683835.490771:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850348288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.490821:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850348288:12345-0@lo:400:kworker.0 Request processed in 51us (2392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.490827:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683835.490839:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789683835.490844:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850348160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.490869:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850348160:12345-0@lo:400:kworker.0 Request processed in 26us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.490875:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789683835.490886:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789683835.490891:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850348032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.490916:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850348032:12345-0@lo:400:kworker.0 Request processed in 25us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.490921:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789683835.490932:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789683835.490938:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850347904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.490965:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850347904:12345-0@lo:400:kworker.0 Request processed in 29us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.490970:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789683835.490989:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683835.490997:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683835.491185:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850346880:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.491198:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850347392:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.491208:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850347904:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.491218:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850347008:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.491228:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850347520:0@lo:400:kworker.0 00010000:00080000:3.0:1789683835.491240:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83e03b80 x1876618850348032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683835.491251:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850348032:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.491291:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1789683835.491301:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850347136:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.491311:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850347648:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.491319:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850348160:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.491330:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850347264:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.491339:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850347776:0@lo:400:kworker.0 00010000:00080000:3.0:1789683835.491349:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83e00700 x1876618850348288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683835.491358:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850348288:0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.491420:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850346752 00000100:00100000:3.0:1789683835.491425:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850346752 00000100:00100000:3.0:1789683835.491458:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789683835.491473:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+24:3650:x1876618850346752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683835.491513:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+24:3650:x1876618850346752:12345-0@lo:400:kworker.0 Request processed in 40us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683835.491519:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789683835.492123:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850346752:0@lo:400:kworker.0 00000100:00100000:1.0:1789683835.493909:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683835.493957:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850348416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683835.494049:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683835.494117:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850348416 00000100:00100000:1.0:1789683835.494127:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850348416 00000100:00100000:1.0:1789683835.494210:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789683835.494221:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850348416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683835.494263:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789683835.494328:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850348416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683835.494337:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789683835.494409:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850348416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683835.505250:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683835.505280:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850348544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683835.505359:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683835.505499:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850348544 00000100:00100000:0.0:1789683835.505508:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850348544 00000100:00100000:0.0:1789683835.505574:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789683835.505584:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850348544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683835.505611:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789683835.505663:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850348544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683835.505670:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789683835.505717:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850348544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683836.003025:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850348672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683836.003095:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683836.007179:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850348672 00000100:00100000:2.0:1789683836.007208:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850348672 00000100:00100000:2.0:1789683836.007268:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789683836.007278:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850348672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683836.007310:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683836.007393:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850348672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (4297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683836.007399:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683836.009360:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850348672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789683836.065477:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789683837.047557:0:24273:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c 00000001:00100000:2.0:1789683837.047582:0:24273:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c6dee52e-fd7e-4613-b7b8-6beab7d04952 00000001:00100000:1.0:1789683837.049458:0:25091:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c 00000001:00100000:1.0:1789683837.049470:0:25091:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6dee52e-fd7e-4613-b7b8-6beab7d04952 00000001:00100000:3.0:1789683837.051521:0:23501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c 00000001:00100000:3.0:1789683837.051533:0:23501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c6dee52e-fd7e-4613-b7b8-6beab7d04952 00000001:00100000:0.0:1789683837.057290:0:22746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c 00000001:00100000:0.0:1789683837.057304:0:22746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c6dee52e-fd7e-4613-b7b8-6beab7d04952 00010000:00010000:0.0:1789683837.088475:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683838.054941:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683838.054962:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850348800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683838.055031:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683838.055075:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850348800 00000100:00100000:2.0:1789683838.055082:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850348800 00000100:00100000:2.0:1789683838.055144:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789683838.055154:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850348800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683838.055183:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683838.055222:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850348800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683838.055229:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789683838.055249:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683838.055280:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850348800:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789683838.132964:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683838.559233:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683838.559257:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850348928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683838.559326:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683838.559370:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850348928 00000100:00100000:2.0:1789683838.559390:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850348928 00000100:00100000:2.0:1789683838.559434:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789683838.559441:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850348928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683838.559473:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789683838.559513:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850348928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683838.559519:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789683838.559561:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850348928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683838.563299:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683838.563322:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850349056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683838.563387:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683838.563437:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850349056 00000100:00100000:1.0:1789683838.563443:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850349056 00000100:00100000:1.0:1789683838.563483:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789683838.563491:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850349056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683838.563523:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683838.563561:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850349056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683838.563568:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789683838.563619:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850349056:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1789683838.775380:0:25649:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789683839.136655:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789683839.455642:0:23519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789683839.519894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683839.519941:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683839.519970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683839.519985:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683839.520011:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683839.520025:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683839.520040:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683839.520053:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683839.520070:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683839.520106:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835552512 00000100:00100000:2.0:1789683839.520115:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835552512 00000100:00100000:2.0:1789683839.520163:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835553024 00000100:00100000:2.0:1789683839.520166:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835553024 00000100:00100000:2.0:1789683839.520178:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835552640 00000100:00100000:2.0:1789683839.520180:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835552640 00000100:00100000:2.0:1789683839.520190:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835553152 00000100:00100000:2.0:1789683839.520192:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835553152 00000100:00100000:2.0:1789683839.520205:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:2.0:1789683839.520215:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835552512:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683839.520298:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835552512:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 84us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683839.520306:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:1.0:1789683839.520475:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:1.0:1789683839.520489:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835553024:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683839.520516:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835553024:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683839.520522:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:1.0:1789683839.520538:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:1.0:1789683839.520543:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835552640:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683839.520561:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835552640:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 19us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683839.520567:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:1.0:1789683839.520576:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:1.0:1789683839.520581:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835553152:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683839.520597:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835553152:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 16us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683839.520602:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:1.0:1789683839.520620:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835552256 00000100:00100000:1.0:1789683839.520623:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835552256 00000100:00100000:1.0:1789683839.520643:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835552768 00000100:00100000:1.0:1789683839.520645:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835552768 00000100:00100000:1.0:1789683839.520654:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835552384 00000100:00100000:1.0:1789683839.520656:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835552384 00000100:00100000:1.0:1789683839.520666:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835552896 00000100:00100000:1.0:1789683839.520668:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835552896 00000100:00100000:1.0:1789683839.520679:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:1.0:1789683839.520685:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:2402:x1876618835552256:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683839.520720:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:2402:x1876618835552256:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 35us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683839.520733:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:1.0:1789683839.520746:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:1.0:1789683839.520751:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:2402:x1876618835552768:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683839.520772:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:2402:x1876618835552768:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 21us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683839.520776:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:1.0:1789683839.520837:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:1.0:1789683839.520844:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835552384:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683839.520865:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835552384:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 23us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683839.520871:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:1.0:1789683839.520881:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:1.0:1789683839.520886:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835552896:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683839.520903:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835552896:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 17us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683839.520908:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00080000:1.0:1789683839.520939:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683839.520943:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683839.520945:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683839.520947:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683839.521515:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835552128 00000100:00100000:3.0:1789683839.521522:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835552128 00000100:00100000:3.0:1789683839.521563:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 148 00000100:00100000:3.0:1789683839.521571:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+13:2402:x1876618835552128:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683839.521615:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+13:2402:x1876618835552128:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 45us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683839.521622:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 148 00010000:00010000:0.0:1789683840.159295:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683840.607115:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683840.607139:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850349184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683840.607212:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683840.607283:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850349184 00000100:00100000:0.0:1789683840.607291:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850349184 00000100:00100000:0.0:1789683840.607343:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789683840.607353:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850349184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683840.607382:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789683840.607513:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850349184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683840.607521:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1789683840.607543:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683840.607598:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850349184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683840.609274:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850349440:0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.609341:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683840.609376:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850349952:0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.609403:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683840.609494:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850350464:0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.609521:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683840.609546:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789683840.609552:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850349568:0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.609574:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683840.609592:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850350080:0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.609611:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683840.609625:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850350592:0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.610629:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683840.610831:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850349952 00000100:00100000:3.0:1789683840.610841:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850349952 00000100:00100000:3.0:1789683840.610900:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850349568 00000100:00100000:3.0:1789683840.610903:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850349568 00000100:00100000:3.0:1789683840.610918:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850350080 00000100:00100000:3.0:1789683840.610921:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850350080 00000100:00100000:3.0:1789683840.610940:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683840.610949:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850349952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.611011:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850349952:12345-0@lo:400:kworker.0 Request processed in 63us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683840.611018:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683840.611034:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683840.611039:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850349568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.611082:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850349568:12345-0@lo:400:kworker.0 Request processed in 42us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683840.611088:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683840.611110:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789683840.611116:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850350080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.611158:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850350080:12345-0@lo:400:kworker.0 Request processed in 42us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683840.611164:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789683840.611183:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850350464 00000100:00100000:3.0:1789683840.611187:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850350464 00000100:00100000:3.0:1789683840.611211:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850350592 00000100:00100000:3.0:1789683840.611214:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850350592 00000100:00100000:3.0:1789683840.611234:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789683840.611240:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850350464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.611270:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850350464:12345-0@lo:400:kworker.0 Request processed in 30us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683840.611275:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789683840.611287:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683840.611293:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850350592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.611319:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850350592:12345-0@lo:400:kworker.0 Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683840.611324:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683840.611375:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850349568:0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.611387:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850350080:0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.611395:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850350592:0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.611405:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850349952:0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.611812:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850349440 00000100:00100000:2.0:1789683840.611820:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850349440 00000100:00100000:2.0:1789683840.611857:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789683840.611863:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850349440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.611903:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850349440:12345-0@lo:400:kworker.0 Request processed in 41us (2562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683840.611909:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789683840.611941:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850349696:0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.611977:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683840.611999:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850350208:0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.612020:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683840.612035:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850350720:0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.612058:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683840.612093:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789683840.612100:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850349312:0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.612125:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683840.612151:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850349824:0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.612173:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683840.612191:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850350336:0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.612210:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683840.612229:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850349312 00000100:00100000:2.0:1789683840.612239:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850349312 00000100:00100000:2.0:1789683840.612267:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789683840.612274:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:3649:x1876618850349312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.612311:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:3649:x1876618850349312:12345-0@lo:400:kworker.0 Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683840.612317:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789683840.612343:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850349824 00000100:00100000:2.0:1789683840.612347:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850349824 00000100:00100000:2.0:1789683840.612369:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683840.612374:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850349824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.612405:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850349824:12345-0@lo:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683840.612411:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683840.613226:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850349696 00000100:00100000:2.0:1789683840.613234:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850349696 00000100:00100000:2.0:1789683840.613257:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850350208 00000100:00100000:2.0:1789683840.613260:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850350208 00000100:00100000:2.0:1789683840.613272:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850350720 00000100:00100000:2.0:1789683840.613275:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850350720 00000100:00100000:2.0:1789683840.613288:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850350336 00000100:00100000:2.0:1789683840.613290:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850350336 00000100:00100000:2.0:1789683840.613303:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789683840.613309:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850349696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.613353:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850349696:12345-0@lo:400:kworker.0 Request processed in 45us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683840.613359:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789683840.613370:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789683840.613375:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850350208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.613412:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850350208:12345-0@lo:400:kworker.0 Request processed in 37us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683840.613581:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789683840.613590:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850350720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683840.613623:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850350720:12345-0@lo:400:kworker.0 Request processed in 35us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683840.613629:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789683840.613656:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789683840.613662:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850350336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683840.613690:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850350336:12345-0@lo:400:kworker.0 Request processed in 30us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683840.613696:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789683840.613711:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683840.613714:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683840.613717:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683840.613719:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683840.614836:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789683840.614908:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:acf86134-5469-4898-92a9-e106d5944cd1:3649:1876618850349312:0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.614923:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850349824:0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.614934:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850350336:0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.614945:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850349696:0@lo:400:kworker.0 00000100:00100000:2.0:1789683840.614953:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850350208:0@lo:400:kworker.0 00010000:00080000:2.0:1789683840.614965:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7d86300 x1876618850350720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683840.614974:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850350720:0@lo:400:kworker.0 00010000:00080000:3.0:1789683840.615085:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7d85500 x1876618850350464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683840.615109:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850350464:0@lo:400:kworker.0 00000100:00100000:3.0:1789683840.615159:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850349440:0@lo:400:kworker.0 00000100:00100000:0.0:1789683840.620760:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850350848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683840.620889:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683840.621229:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850350848 00000100:00100000:1.0:1789683840.621239:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850350848 00000100:00100000:1.0:1789683840.621293:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789683840.621303:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850350848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683840.621340:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789683840.629901:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850350848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8588us (9000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683840.629918:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683840.641608:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850350848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683841.124950:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683841.124974:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850350976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683841.125039:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683841.125104:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850350976 00000100:00100000:1.0:1789683841.125111:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850350976 00000100:00100000:1.0:1789683841.125156:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789683841.125165:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850350976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683841.125194:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789683841.125235:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850350976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683841.125241:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789683841.125286:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850350976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789683841.193444:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683842.208758:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683842.920180:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789683843.167917:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850351104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683843.168008:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683843.169185:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850351104 00000100:00100000:0.0:1789683843.169198:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850351104 00000100:00100000:0.0:1789683843.169271:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789683843.169283:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850351104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683843.169317:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789683843.169382:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850351104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683843.169389:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789683843.169468:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850351104:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789683843.171205:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789683843.231360:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683843.685381:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683843.685406:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850351232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683843.685485:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683843.685540:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850351232 00000100:00100000:3.0:1789683843.685548:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850351232 00000100:00100000:3.0:1789683843.685598:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789683843.685609:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850351232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683843.685643:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789683843.685687:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850351232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683843.685693:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789683843.685748:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850351232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683843.695962:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683843.695984:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850351360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683843.696074:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683843.696127:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850351360 00000100:00100000:1.0:1789683843.696134:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850351360 00000100:00100000:1.0:1789683843.696174:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683843.696188:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850351360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683843.696224:0:23773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683843.696265:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850351360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683843.696271:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683843.696315:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850351360:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789683844.261770:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789683844.396174:0:25797:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd904d7b30 20000000:00000080:2.0:1789683844.396193:0:25797:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0f9e820800 uarg=0000000000000000 20000000:01000000:2.0:1789683844.396246:0:25797:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789683844.396251:0:25797:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789683844.396255:0:25797:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789683844.398479:0:25798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789683844.399108:0:25797:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789683844.406026:0:25797:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789683844.406059:0:25797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406078:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb1bc2800/0xcf8485587b88b260 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b259 expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406086:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb7a30400/0xcf8485587b88b26e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b267 expref: 23 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406106:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb1bc2000/0xcf8485587b88b2ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b2a6 expref: 23 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406113:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b42e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b427 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406123:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88b593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb25 expref: 12 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406129:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b5d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb95 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406136:0:25797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406181:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b5d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb95 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406199:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b5d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb95 expref: 12 pid: 22761 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683844.406216:0:25797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850351488:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683844.406482:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88b593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb25 expref: 12 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406492:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88b593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb25 expref: 12 pid: 22759 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683844.406501:0:25797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850351616:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683844.406542:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b42e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b427 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406551:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b42e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b427 expref: 23 pid: 22761 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683844.406561:0:25797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850351744:0@lo:104: 00000100:00100000:2.0:1789683844.406600:0:25797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683844.406697:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb1bc2000/0xcf8485587b88b2ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b2a6 expref: 23 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.406705:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb1bc2000/0xcf8485587b88b2ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b2a6 expref: 23 pid: 22760 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683844.406713:0:25797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850351872:0@lo:104: 00000100:00100000:2.0:1789683844.406732:0:25797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683844.410395:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683844.410504:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683844.410641:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835553280 00000100:00100000:0.0:1789683844.410651:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835553280 00010000:00010000:0.0:1789683844.410696:0:22753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b5d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb95 expref: 13 pid: 22761 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683844.410732:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835553408 00000100:00100000:0.0:1789683844.410736:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835553408 00010000:00010000:0.0:1789683844.410747:0:22753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88b593 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb25 expref: 14 pid: 22759 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683844.410761:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:0.0:1789683844.410770:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04575703-9878-47d6-810f-62226c59585b+14:2402:x1876618835553280:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683844.410806:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683844.410812:0:22753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b5d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb95 expref: 14 pid: 22761 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683844.410824:0:22753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b5d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb95 expref: 14 pid: 22761 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683844.410844:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683844.410895:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04575703-9878-47d6-810f-62226c59585b+14:2402:x1876618835553280:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 126us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683844.410902:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:0.0:1789683844.410919:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:0.0:1789683844.410925:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04575703-9878-47d6-810f-62226c59585b+13:2402:x1876618835553408:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683844.410944:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683844.410948:0:22753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88b593 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb25 expref: 13 pid: 22759 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683844.410955:0:22753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88b593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb25 expref: 13 pid: 22759 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683844.410963:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683844.410980:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04575703-9878-47d6-810f-62226c59585b+13:2402:x1876618835553408:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 56us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683844.410986:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00010000:00010000:2.0:1789683844.412213:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb7a30400/0xcf8485587b88b26e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b267 expref: 23 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.412230:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb7a30400/0xcf8485587b88b26e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b267 expref: 23 pid: 22760 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683844.412244:0:25797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850352000:0@lo:104: 00000100:00100000:2.0:1789683844.412736:0:25797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683844.412883:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850351744 00000100:00100000:3.0:1789683844.412891:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850351744 00000100:00100000:3.0:1789683844.412931:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850351872 00000100:00100000:3.0:1789683844.412934:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850351872 00000100:00100000:3.0:1789683844.412947:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683844.412956:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+4:25797:x1876618850351744:12345-0@lo:104: 00010000:00010000:3.0:1789683844.412969:0:22749:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413036:0:22749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683844.413041:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+4:25797:x1876618850351744:12345-0@lo:104: Request processed in 87us (6441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683844.413058:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683844.413074:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683844.413080:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+3:25797:x1876618850351872:12345-0@lo:104: 00010000:00010000:3.0:1789683844.413087:0:22749:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413120:0:22749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683844.413124:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+3:25797:x1876618850351872:12345-0@lo:104: Request processed in 46us (6392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683844.413130:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789683844.413147:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683844.413153:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413159:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ca00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683844.413163:0:23923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413171:0:23923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683844.413178:0:23923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683844.413184:0:23923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789683844.413216:0:23923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413223:0:23923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683844.413249:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413256:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ca00/0xcf8485587b88b427 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b42e expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413272:0:23923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683844.413275:0:23923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413294:0:23923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683844.413297:0:23923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413303:0:23923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683844.413308:0:23923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683844.413312:0:23923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789683844.413326:0:23923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413332:0:23923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683844.413336:0:23923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413342:0:23923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31c00/0xcf8485587b88b2a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b2ad expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413360:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683844.413362:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683844.413363:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683844.413384:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850352128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683844.413417:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683844.413442:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683844.413448:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850352256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683844.413486:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683844.413511:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850352128 00000100:00100000:3.0:1789683844.413515:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850352128 00010000:00010000:3.0:1789683844.413533:0:22751:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b42e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b427 expref: 24 pid: 22761 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683844.413549:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850352256 00000100:00100000:3.0:1789683844.413551:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850352256 00010000:00010000:3.0:1789683844.413560:0:22751:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb1bc2000/0xcf8485587b88b2ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b2a6 expref: 25 pid: 22760 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683844.413570:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683844.413575:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acf86134-5469-4898-92a9-e106d5944cd1+25:3647:x1876618850352128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683844.413583:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683844.413588:0:22751:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b42e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b427 expref: 25 pid: 22761 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413598:0:22751:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b42e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b427 expref: 25 pid: 22761 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413611:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683844.413644:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acf86134-5469-4898-92a9-e106d5944cd1+25:3647:x1876618850352128:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683844.413650:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683844.413661:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683844.413667:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acf86134-5469-4898-92a9-e106d5944cd1+24:3647:x1876618850352256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683844.413674:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683844.413678:0:22751:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb1bc2000/0xcf8485587b88b2ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b2a6 expref: 24 pid: 22760 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413687:0:22751:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb1bc2000/0xcf8485587b88b2ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b2a6 expref: 24 pid: 22760 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.413697:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683844.413718:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acf86134-5469-4898-92a9-e106d5944cd1+24:3647:x1876618850352256:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683844.413723:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683844.413751:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850352256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683844.413761:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:acf86134-5469-4898-92a9-e106d5944cd1:3647:1876618850352128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683844.414192:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683844.414652:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb1bc2800/0xcf8485587b88b260 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88b259 expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.414667:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb1bc2800/0xcf8485587b88b260 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88b259 expref: 23 pid: 22759 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683844.414692:0:25797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850352384:0@lo:104: 00000100:00100000:2.0:1789683844.414723:0:25797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683844.414806:0:25797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720240 going to sleep for 11 seconds 00010000:00010000:2.0:1789683844.414828:0:25797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb7a31400/0xcf8485587b88b5d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb95 expref: 12 pid: 22761 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683844.414842:0:25797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850351488:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683844.414854:0:25797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88b593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb25 expref: 11 pid: 22759 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683844.414862:0:25797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850351616:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683844.414871:0:25797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9200/0xcf8485587b88b42e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b427 expref: 23 pid: 22761 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683844.414877:0:25797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850351744:0@lo:104: 00010000:00010000:2.0:1789683844.414886:0:25797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb1bc2000/0xcf8485587b88b2ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b2a6 expref: 22 pid: 22760 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683844.414892:0:25797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850351872:0@lo:104: 00000100:00100000:3.0:1789683844.415022:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850352000 00000100:00100000:3.0:1789683844.415028:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850352000 00000100:00100000:0.0:1789683844.415103:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850352384 00000100:00100000:0.0:1789683844.415106:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850352384 00000100:00100000:0.0:1789683844.415118:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683844.415126:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+4:25797:x1876618850352000:12345-0@lo:104: 00010000:00010000:0.0:1789683844.415140:0:22749:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683844.415218:0:22749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789683844.415226:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+4:25797:x1876618850352000:12345-0@lo:104: Request processed in 100us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683844.415233:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683844.415248:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683844.415254:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+3:25797:x1876618850352384:12345-0@lo:104: 00010000:00010000:0.0:1789683844.415262:0:22749:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683844.415314:0:22749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789683844.415319:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:acf86134-5469-4898-92a9-e106d5944cd1+3:25797:x1876618850352384:12345-0@lo:104: Request processed in 66us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683844.415326:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789683844.415383:0:25797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850352000:0@lo:104: 00000100:00100000:2.0:1789683844.415391:0:25797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1876618850352384:0@lo:104: 00010000:00010000:2.0:1789683844.415415:0:25797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.415580:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683844.415588:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.415596:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2400 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683844.415601:0:22754:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.415621:0:22754:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683844.415627:0:22754:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683844.415633:0:22754:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789683844.415669:0:22754:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.415675:0:22754:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683844.415703:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.415711:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb1bc2400/0xcf8485587b88b267 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b26e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.415723:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683844.415726:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.415732:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30800 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683844.415735:0:22754:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.415742:0:22754:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683844.415749:0:22754:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683844.415760:0:22754:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789683844.415774:0:22754:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.415780:0:22754:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683844.415814:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.415821:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30800/0xcf8485587b88b259 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88b260 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.415835:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683844.415837:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683844.415839:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683844.415845:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683844.415857:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850352640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683844.415891:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683844.415922:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683844.415928:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850352512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683844.415949:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683844.415974:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850352640 00000100:00100000:3.0:1789683844.415979:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850352640 00010000:00010000:3.0:1789683844.416013:0:22752:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb1bc2800/0xcf8485587b88b260 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b259 expref: 22 pid: 22759 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683844.416035:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850352512 00000100:00100000:3.0:1789683844.416037:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850352512 00010000:00010000:3.0:1789683844.416049:0:22752:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb7a30400/0xcf8485587b88b26e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b267 expref: 23 pid: 22760 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683844.416073:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683844.416079:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:acf86134-5469-4898-92a9-e106d5944cd1+23:3650:x1876618850352640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683844.416090:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683844.416095:0:22752:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb1bc2800/0xcf8485587b88b260 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b259 expref: 23 pid: 22759 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416104:0:22752:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb1bc2800/0xcf8485587b88b260 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b259 expref: 23 pid: 22759 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416116:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb1bc2800/0xcf8485587b88b260 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b259 expref: 23 pid: 22759 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416126:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683844.416156:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:acf86134-5469-4898-92a9-e106d5944cd1+22:3650:x1876618850352640:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683844.416162:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683844.416200:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683844.416206:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:acf86134-5469-4898-92a9-e106d5944cd1+21:3650:x1876618850352512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683844.416212:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683844.416216:0:22752:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb7a30400/0xcf8485587b88b26e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88b267 expref: 21 pid: 22760 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416226:0:22752:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb7a30400/0xcf8485587b88b26e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88b267 expref: 21 pid: 22760 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416235:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb7a30400/0xcf8485587b88b26e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88b267 expref: 21 pid: 22760 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416257:0:22752:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416265:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416292:0:22752:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416300:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416306:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416313:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416318:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683844.416323:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416331:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416341:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683844.416350:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683844.416369:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:acf86134-5469-4898-92a9-e106d5944cd1+20:3650:x1876618850352512:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683844.416381:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683844.416412:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850352512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683844.416420:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:acf86134-5469-4898-92a9-e106d5944cd1:3650:1876618850352640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683844.416524:0:25797:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.416543:0:25797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683844.416550:0:25797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb7a31a00/0xcf8485587b88b603 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683844.649824:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683844.649876:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683844.649900:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683844.649925:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683844.649945:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683844.649964:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683844.649983:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683844.650018:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683844.650053:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835553536 00000100:00100000:2.0:1789683844.650062:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835553536 00000100:00100000:2.0:1789683844.650116:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835554048 00000100:00100000:2.0:1789683844.650120:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835554048 00000100:00100000:2.0:1789683844.650132:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835553664 00000100:00100000:2.0:1789683844.650135:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835553664 00000100:00100000:2.0:1789683844.650146:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835554176 00000100:00100000:2.0:1789683844.650148:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835554176 00000100:00100000:2.0:1789683844.650164:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:2.0:1789683844.650174:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:2402:x1876618835553536:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683844.650249:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:2402:x1876618835553536:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 76us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683844.650256:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:2.0:1789683844.650275:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:2.0:1789683844.650294:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:2402:x1876618835554048:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683844.650320:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:2402:x1876618835554048:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683844.650326:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:2.0:1789683844.650337:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:2.0:1789683844.650343:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835553664:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683844.650366:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835553664:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 23us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683844.650371:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:2.0:1789683844.650383:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:2.0:1789683844.650388:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835554176:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683844.650409:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835554176:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 21us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683844.650414:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:2.0:1789683844.650432:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835553792 00000100:00100000:2.0:1789683844.650435:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835553792 00000100:00100000:2.0:1789683844.650453:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835554304 00000100:00100000:2.0:1789683844.650456:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835554304 00000100:00100000:2.0:1789683844.650466:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835553920 00000100:00100000:2.0:1789683844.650468:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835553920 00000100:00100000:2.0:1789683844.650477:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835554432 00000100:00100000:2.0:1789683844.650479:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835554432 00000100:00100000:2.0:1789683844.650680:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:2.0:1789683844.650688:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0faed63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835553792:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683844.650717:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0faed63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835553792:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 31us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683844.650733:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:3.0:1789683844.650847:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:3.0:1789683844.650858:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835554304:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683844.650885:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835554304:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 31us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683844.650890:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:3.0:1789683844.650903:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789683844.650908:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835553920:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683844.650930:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2402:x1876618835553920:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683844.650936:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789683844.650947:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:3.0:1789683844.650954:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835554432:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683844.650977:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835554432:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683844.650982:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00080000:2.0:1789683844.651318:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683844.651322:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683844.651325:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683844.651327:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789683845.279253:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789683845.539108:0:22763:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683845.539116:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0e8108d000 from 13 10000000:01000000:2.0:1789683845.539122:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683845.539171:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b60a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683845.539182:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b60a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683845.539193:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b60a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683845.539218:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850352768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683845.539301:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.539349:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720240 going to sleep for 11 seconds 00000100:00100000:0.0:1789683845.539881:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850352768 00000100:00100000:0.0:1789683845.539890:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850352768 00000100:00100000:0.0:1789683845.539948:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789683845.539958:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+20:22763:x1876618850352768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683845.540169:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683845.540187:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454d200/0xcf8485587b88b611 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b60a expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683845.540215:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454d200/0xcf8485587b88b611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b60a expref: 21 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683845.540226:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454d200/0xcf8485587b88b611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b60a expref: 21 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683845.540236:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d200, rc 0) 00000100:00100000:0.0:1789683845.540311:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+21:22763:x1876618850352768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 355us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683845.540317:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789683845.540417:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850352768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683845.540433:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b60a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b611 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683845.540479:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b60a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b611 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683845.540555:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850352896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683845.540585:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683845.540619:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e844f5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683845.540908:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850352896 00000100:00100000:2.0:1789683845.540915:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850352896 00000100:00100000:2.0:1789683845.540948:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789683845.540955:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:22763:x1876618850352896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683845.541098:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:22763:x1876618850352896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.541104:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789683845.541214:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850352896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683845.541250:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683845.541293:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683845.541324:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87e43d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683845.541387:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850353024 00000100:00100000:2.0:1789683845.541398:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850353024 00000100:00100000:2.0:1789683845.541427:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789683845.541433:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:22763:x1876618850353024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683845.541510:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+21:22763:x1876618850353024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.541517:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789683845.541596:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789683845.545664:0:25810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789683845.545943:0:22763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789683845.545970:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683845.545991:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b60a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b611 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683845.546003:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31400/0xcf8485587b88b60a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b611 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683845.546015:0:22763:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789683845.546018:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f86d6b800 from 13 10000000:01000000:3.0:1789683845.546021:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683845.546064:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e845c2200/0xcf8485587b88b618 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683845.546073:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e845c2200/0xcf8485587b88b618 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683845.546086:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e845c2200/0xcf8485587b88b618 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683845.546113:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683845.546185:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683845.546238:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e844f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683845.546358:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850353152 00000100:00100000:0.0:1789683845.546366:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850353152 00000100:00100000:0.0:1789683845.546420:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789683845.546431:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+21:22763:x1876618850353152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683845.546474:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683845.546489:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454de00/0xcf8485587b88b61f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b618 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683845.546512:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454de00/0xcf8485587b88b61f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b618 expref: 22 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683845.546522:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454de00/0xcf8485587b88b61f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b618 expref: 22 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683845.546530:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454de00, rc 0) 00000100:00100000:0.0:1789683845.546578:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+22:22763:x1876618850353152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683845.546586:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789683845.547619:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683845.547640:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e845c2200/0xcf8485587b88b618 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b61f expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683845.547651:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e845c2200/0xcf8485587b88b618 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b61f expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683845.547724:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683845.547768:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683845.547834:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e844f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683845.549870:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850353280 00000100:00100000:2.0:1789683845.549893:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850353280 00000100:00100000:2.0:1789683845.549984:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789683845.549993:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+22:22763:x1876618850353280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683845.550164:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+22:22763:x1876618850353280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.550172:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789683845.551461:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683845.551520:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683845.551583:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683845.551628:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e844f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683845.554386:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850353408 00000100:00100000:0.0:1789683845.554402:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850353408 00000100:00100000:0.0:1789683845.554480:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789683845.554491:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+22:22763:x1876618850353408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683845.554656:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+22:22763:x1876618850353408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (3072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683845.554665:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789683845.555212:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789683845.558485:0:25811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789683845.559006:0:22763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789683845.559035:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683845.559047:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e845c2200/0xcf8485587b88b618 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b61f expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683845.559060:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e845c2200/0xcf8485587b88b618 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b61f expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683845.559072:0:22763:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789683845.559075:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fa7d90800 from 13 10000000:01000000:3.0:1789683845.559078:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683845.559141:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e845c3400/0xcf8485587b88b626 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683845.559149:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e845c3400/0xcf8485587b88b626 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683845.559160:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e845c3400/0xcf8485587b88b626 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683845.559187:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683845.559273:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683845.559320:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e844f5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683845.559384:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850353536 00000100:00100000:1.0:1789683845.559392:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850353536 00000100:00100000:1.0:1789683845.559470:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789683845.559480:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+22:22763:x1876618850353536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683845.559495:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683845.559509:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b62d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b626 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683845.559530:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b62d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b626 expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683845.559540:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b88b62d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b626 expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683845.559556:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9c00, rc 0) 00000100:00100000:1.0:1789683845.559601:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+23:22763:x1876618850353536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683845.559608:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789683845.560254:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683845.560285:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e845c3400/0xcf8485587b88b626 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b62d expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683845.560295:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e845c3400/0xcf8485587b88b626 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b62d expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683845.560364:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683845.560399:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.560839:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683845.574558:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850353664 00000100:00100000:3.0:1789683845.574575:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850353664 00000100:00100000:3.0:1789683845.574657:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789683845.574669:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+23:22763:x1876618850353664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683845.574897:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+23:22763:x1876618850353664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (14495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683845.574904:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789683845.575036:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683845.575091:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683845.575154:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.575188:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683845.575248:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850353792 00000100:00100000:1.0:1789683845.575252:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850353792 00000100:00100000:1.0:1789683845.575295:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789683845.575301:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+23:22763:x1876618850353792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683845.575379:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+23:22763:x1876618850353792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683845.575396:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789683845.575647:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789683845.576747:0:25812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789683845.577057:0:22763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789683845.577085:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683845.577098:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e845c3400/0xcf8485587b88b626 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b62d expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683845.577111:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e845c3400/0xcf8485587b88b626 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b62d expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683845.577123:0:22763:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683845.577126:0:22763:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fc06b2000 from 13 10000000:01000000:2.0:1789683845.577129:0:22763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683845.577167:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30c00/0xcf8485587b88b634 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683845.577177:0:22763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30c00/0xcf8485587b88b634 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683845.577189:0:22763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30c00/0xcf8485587b88b634 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683845.577211:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683845.577269:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.577302:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e837203c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683845.577492:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850353920 00000100:00100000:1.0:1789683845.577500:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850353920 00000100:00100000:1.0:1789683845.577544:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789683845.577551:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+23:22763:x1876618850353920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683845.577562:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683845.577574:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b63b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88b634 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683845.577595:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b63b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88b634 expref: 24 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683845.577604:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f8000/0xcf8485587b88b63b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88b634 expref: 24 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683845.577612:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8000, rc 0) 00000100:00100000:1.0:1789683845.577658:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acf86134-5469-4898-92a9-e106d5944cd1+24:22763:x1876618850353920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683845.577664:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789683845.577874:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850353920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683845.577888:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30c00/0xcf8485587b88b634 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b63b expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683845.577907:0:22763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30c00/0xcf8485587b88b634 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88b63b expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683845.577957:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850354048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683845.577992:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.578010:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e837203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683845.578081:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850354048 00000100:00100000:3.0:1789683845.578085:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850354048 00000100:00100000:3.0:1789683845.578107:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789683845.578113:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+24:22763:x1876618850354048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683845.578229:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+24:22763:x1876618850354048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683845.578236:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789683845.578361:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850354048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683845.578386:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850354176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683845.578422:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.578453:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e837203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683845.578532:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850354176 00000100:00100000:3.0:1789683845.578537:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850354176 00000100:00100000:3.0:1789683845.578559:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789683845.578565:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86c98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+24:22763:x1876618850354176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683845.578644:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86c98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acf86134-5469-4898-92a9-e106d5944cd1+24:22763:x1876618850354176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683845.578651:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789683845.580453:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:acf86134-5469-4898-92a9-e106d5944cd1:22763:1876618850354176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789683845.583588:0:25813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789683845.584707:0:22763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789683845.584736:0:22763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683845.584748:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30c00/0xcf8485587b88b634 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b63b expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683845.584760:0:22763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a30c00/0xcf8485587b88b634 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88b63b expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683845.601031:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683845.601192:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835554560 00000100:00100000:3.0:1789683845.601202:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835554560 00000100:00100000:3.0:1789683845.601267:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:3.0:1789683845.601278:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+11:18105:x1876618835554560:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683845.601296:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683845.601314:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e845c2000/0xcf8485587b88b642 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcbcd expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683845.601345:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e845c2000/0xcf8485587b88b642 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbcd expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683845.601356:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e845c2000/0xcf8485587b88b642 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbcd expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683845.601366:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c2000, rc 0) 00000100:00100000:3.0:1789683845.602111:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+12:18105:x1876618835554560:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 158us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683845.602124:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:1.0:1789683845.605673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683845.605756:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835554688 00000100:00100000:0.0:1789683845.605766:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835554688 00000100:00100000:0.0:1789683845.605845:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:0.0:1789683845.605869:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+12:18105:x1876618835554688:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683845.606048:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+12:18105:x1876618835554688:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 180us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683845.606055:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:0.0:1789683845.615145:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683845.615660:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835554816 00000100:00100000:3.0:1789683845.615673:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835554816 00000100:00100000:3.0:1789683845.615732:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:3.0:1789683845.615741:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+12:18105:x1876618835554816:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683845.615937:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+12:18105:x1876618835554816:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 196us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683845.615945:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:0.0:1789683845.622260:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683845.622359:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835554944 00000100:00100000:1.0:1789683845.622370:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835554944 00000100:00100000:1.0:1789683845.622435:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:1.0:1789683845.622462:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+12:18105:x1876618835554944:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683845.622481:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683845.622500:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f8200/0xcf8485587b88b649 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcbd4 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683845.622531:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f8200/0xcf8485587b88b649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbd4 expref: 13 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683845.622543:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f8200/0xcf8485587b88b649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbd4 expref: 13 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683845.622552:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8200, rc 0) 00000100:00100000:1.0:1789683845.622612:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+13:18105:x1876618835554944:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 163us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683845.622620:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:1.0:1789683845.625560:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683845.625646:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835555072 00000100:00100000:0.0:1789683845.625656:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835555072 00000100:00100000:0.0:1789683845.625712:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 166 00000100:00100000:0.0:1789683845.625723:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+13:18105:x1876618835555072:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683845.625916:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04575703-9878-47d6-810f-62226c59585b+13:18105:x1876618835555072:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 194us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683845.625924:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 166 00000100:00100000:0.0:1789683845.638114:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683845.639581:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835555200 00000100:00100000:3.0:1789683845.639597:0:22760:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835555200 00000100:00100000:3.0:1789683845.639669:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:3.0:1789683845.639680:0:22760:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+13:18105:x1876618835555200:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683845.639862:0:22760:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04575703-9878-47d6-810f-62226c59585b+13:18105:x1876618835555200:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 183us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683845.639871:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:1.0:1789683845.727335:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850354432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683845.727348:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850354304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683845.727543:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850354560:0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.739158:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.739227:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850354816:0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.739268:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.739289:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850355328:0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.739311:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.739349:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850355840:0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.739375:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.739395:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789683845.739402:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850354944:0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.739422:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.739460:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850355456:0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.739481:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.739498:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850355968:0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.739517:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.739548:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850354816 00000100:00100000:2.0:1789683845.739556:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850354816 00000100:00100000:2.0:1789683845.739604:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850355328 00000100:00100000:2.0:1789683845.739607:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850355328 00000100:00100000:2.0:1789683845.739630:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683845.739637:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850354816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.739693:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850354816:12345-0@lo:400:kworker.0 Request processed in 56us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.739699:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683845.739718:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683845.739723:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850355328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.739749:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850355328:12345-0@lo:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.739754:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683845.739772:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850355840 00000100:00100000:2.0:1789683845.739775:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850355840 00000100:00100000:2.0:1789683845.739823:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850354944 00000100:00100000:2.0:1789683845.739826:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850354944 00000100:00100000:2.0:1789683845.739846:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850355456 00000100:00100000:2.0:1789683845.739850:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850355456 00000100:00100000:2.0:1789683845.739860:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850355968 00000100:00100000:2.0:1789683845.739862:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850355968 00000100:00100000:2.0:1789683845.739875:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789683845.739881:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850355840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.739912:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850355840:12345-0@lo:400:kworker.0 Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.739918:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789683845.739930:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789683845.739935:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850354944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.739960:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850354944:12345-0@lo:400:kworker.0 Request processed in 26us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.739965:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789683845.739987:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789683845.739993:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850355456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.740019:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850355456:12345-0@lo:400:kworker.0 Request processed in 26us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.740024:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789683845.740035:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789683845.740041:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850355968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.740065:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850355968:12345-0@lo:400:kworker.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.740071:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789683845.740095:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683845.740098:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683845.740100:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683845.740141:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850354944:0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.740151:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850355456:0@lo:400:kworker.0 00010000:00080000:2.0:1789683845.740163:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7dec380 x1876618850355968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683845.740172:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850355968:0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.740180:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850354816:0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.740187:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850355328:0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.740194:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850355840:0@lo:400:kworker.0 00000100:00100000:3.0:1789683845.741246:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850354304 00000100:00100000:3.0:1789683845.741256:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850354304 00000100:00100000:3.0:1789683845.741309:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789683845.741317:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850354304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683845.741341:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789683845.741405:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850354304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683845.741411:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789683845.741829:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850354304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683845.758516:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683845.758621:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850354688:0@lo:400:kworker.0 00000100:00100000:1.0:1789683845.758678:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683845.758711:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850355200:0@lo:400:kworker.0 00000100:00100000:1.0:1789683845.758733:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683845.758750:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850355712:0@lo:400:kworker.0 00000100:00100000:1.0:1789683845.758771:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.758905:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850354688 00000100:00100000:2.0:1789683845.758915:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850354688 00000100:00100000:3.0:1789683845.758940:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850354432 00000100:00100000:3.0:1789683845.758945:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850354432 00000100:00100000:2.0:1789683845.758994:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850355200 00000100:00100000:3.0:1789683845.758998:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683845.758998:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850355200 00000100:00100000:3.0:1789683845.759006:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850354432:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683845.759016:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683845.759037:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850354688:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789683845.759040:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789683845.759085:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850354432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.759085:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850354688:12345-0@lo:400:kworker.0 Request processed in 62us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683845.759093:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683845.759093:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683845.759109:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789683845.759115:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850355200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.759140:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850355200:12345-0@lo:400:kworker.0 Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683845.759141:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850354432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683845.759145:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789683845.759170:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850355712 00000100:00100000:2.0:1789683845.759174:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850355712 00000100:00100000:2.0:1789683845.759217:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789683845.759224:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850355712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.759255:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850355712:12345-0@lo:400:kworker.0 Request processed in 32us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.759261:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789683845.759603:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683845.759608:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683845.759628:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850354688:0@lo:400:kworker.0 00000100:00100000:1.0:1789683845.759638:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850355200:0@lo:400:kworker.0 00010000:00080000:1.0:1789683845.759648:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7dec700 x1876618850355712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683845.759659:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850355712:0@lo:400:kworker.0 00000100:00100000:0.0:1789683845.761870:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683845.761988:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850355072:0@lo:400:kworker.0 00000100:00100000:0.0:1789683845.762017:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683845.770281:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850355584:0@lo:400:kworker.0 00000100:00100000:0.0:1789683845.770347:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683845.770991:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850355584 00000100:00100000:2.0:1789683845.771001:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850355584 00000100:00100000:2.0:1789683845.771082:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789683845.771092:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850355584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.771158:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850355584:12345-0@lo:400:kworker.0 Request processed in 68us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.771165:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1789683845.775664:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683845.775737:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850355584:0@lo:400:kworker.0 00000100:00100000:3.0:1789683845.776146:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850354560 00000100:00100000:3.0:1789683845.776157:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850354560 00000100:00100000:2.0:1789683845.776314:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850355072 00000100:00100000:2.0:1789683845.776318:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850355072 00000100:00100000:2.0:1789683845.776334:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789683845.776343:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850354560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.776466:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850354560:12345-0@lo:400:kworker.0 Request processed in 124us (14602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.776473:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789683845.776491:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789683845.776498:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850355072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683845.776529:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850355072:12345-0@lo:400:kworker.0 Request processed in 32us (14511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683845.776535:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789683845.776986:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850354560:0@lo:400:kworker.0 00000100:00100000:0.0:1789683845.777001:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850355072:0@lo:400:kworker.0 00000100:00100000:0.0:1789683846.239069:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850356096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683846.239147:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683846.239505:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850356096 00000100:00100000:3.0:1789683846.239514:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850356096 00000100:00100000:3.0:1789683846.239576:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683846.239587:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850356096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683846.239617:0:24281:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789683846.239672:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850356096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683846.239680:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683846.239712:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850356096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683846.283852:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.284017:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835555328 00000100:00100000:0.0:1789683846.284040:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835555328 00000100:00100000:0.0:1789683846.284141:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:0.0:1789683846.284153:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:18728:x1876618835555328:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683846.284184:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683846.284214:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b88b650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcbdb expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284291:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88b657 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284306:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88b657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284319:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88b657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284333:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88b65e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284350:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88b65e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284357:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88b65e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284462:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b88b665 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284470:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b88b665 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284477:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b88b665 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683846.284508:0:22768:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789683846.284511:0:22768:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683846.284545:0:22768:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b88b665 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284555:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88b657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284562:0:22768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88b657 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284569:0:22768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88b657 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284575:0:22768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683846.284579:0:22768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88b657 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284586:0:22768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88b657 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284598:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:0.0:1789683846.284608:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683846.284613:0:22768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88b657 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284619:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88b657 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284635:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88b65e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284640:0:22768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88b65e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284646:0:22768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88b65e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284651:0:22768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683846.284654:0:22768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88b65e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284659:0:22768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88b65e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284666:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f0f854c2500) 00010000:00010000:0.0:1789683846.284668:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683846.284671:0:22768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88b65e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284676:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88b65e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284708:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b88b650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbdb expref: 8 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284733:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b88b665 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbdb expref: 7 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.284739:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0f854c2b00) 00010000:00010000:0.0:1789683846.284741:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683846.284744:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c200, rc 0) 00000100:00100000:0.0:1789683846.284854:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:18728:x1876618835555328:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 703us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683846.284862:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00080000:1.0:1789683846.285581:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683846.291749:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.293154:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835555456 00000100:00100000:0.0:1789683846.293168:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835555456 00000100:00100000:0.0:1789683846.293246:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:0.0:1789683846.293257:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:18728:x1876618835555456:12345-192.168.201.50@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789683846.293538:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:18728:x1876618835555456:12345-192.168.201.50@tcp:900:lhsmtool_posix.0 Request processed in 282us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683846.293547:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:0.0:1789683846.298626:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683846.298734:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835555712 00000100:00100000:2.0:1789683846.298745:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835555712 00000100:00100000:2.0:1789683846.298853:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789683846.298864:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:18728:x1876618835555712:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683846.298889:0:25531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683846.298916:0:25531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b66c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcbe2 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299009:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b673 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299181:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b673 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299199:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b673 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299216:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b67a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299223:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b67a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299230:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b67a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299358:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88b681 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299367:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88b681 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299375:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88b681 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683846.299396:0:25531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789683846.299546:0:25531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b673 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299554:0:25531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b673 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299561:0:25531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b673 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299567:0:25531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683846.299572:0:25531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b673 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299579:0:25531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b673 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299591:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0f854c2b00) 00010000:00010000:2.0:1789683846.299594:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683846.299599:0:25531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b673 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299605:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b673 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299620:0:25531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b67a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299625:0:25531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b67a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299640:0:25531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b67a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299645:0:25531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683846.299648:0:25531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b67a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299655:0:25531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b67a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299663:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f0f853e3900) 00010000:00010000:2.0:1789683846.299665:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683846.299668:0:25531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b67a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.299674:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b67a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.307050:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b66c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbe2 expref: 10 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.307079:0:25531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88b681 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbe2 expref: 9 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.307088:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f853e3b00) 00010000:00010000:2.0:1789683846.307091:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683846.307094:0:25531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30800, rc 0) 00000100:00100000:2.0:1789683846.307180:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+9:18728:x1876618835555712:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 8317us (8564us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789683846.307205:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00010000:00010000:2.0:1789683846.307613:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683846.311458:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.313641:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835555840 00000100:00100000:0.0:1789683846.313657:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835555840 00000100:00100000:0.0:1789683846.313807:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:0.0:1789683846.313819:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+9:18728:x1876618835555840:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789683846.316017:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+9:18728:x1876618835555840:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 2191us (4568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683846.316031:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:3.0:1789683846.337522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.337771:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835555968 00000100:00100000:0.0:1789683846.337827:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835555968 00000100:00100000:0.0:1789683846.338039:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:0.0:1789683846.338052:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:18728:x1876618835555968:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1789683846.338173:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1789683846.342694:0:22766:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4595us 00000100:00100000:1.0:1789683846.372510:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:18728:x1876618835555968:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 34448us (34984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683846.372524:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:1.0:1789683846.376865:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683846.377996:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835556096 00000100:00100000:2.0:1789683846.378009:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835556096 00000100:00100000:2.0:1789683846.378131:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:2.0:1789683846.378144:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+9:18734:x1876618835556096:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683846.378166:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683846.378189:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b68f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcbe9 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378272:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b696 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378286:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378297:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378309:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b69d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378315:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b69d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378322:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b69d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378366:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378383:0:22767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b696 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378389:0:22767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b696 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378395:0:22767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683846.378399:0:22767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b696 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378405:0:22767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b696 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378416:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:2.0:1789683846.378419:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683846.378729:0:22767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b696 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378738:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378751:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b69d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378756:0:22767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b69d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378762:0:22767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b69d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378767:0:22767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683846.378777:0:22767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b69d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378911:0:22767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b69d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378921:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0f853e3900) 00010000:00010000:2.0:1789683846.378924:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683846.378927:0:22767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b69d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378933:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b69d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378978:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b68f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbe9 expref: 10 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.378989:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:2.0:1789683846.378991:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683846.378995:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b68f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbe9 expref: 10 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.379004:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30000, rc 0) 00000100:00100000:2.0:1789683846.379069:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+9:18734:x1876618835556096:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 928us (2213us total) trans 0 rc 301/301 00000100:00100000:2.0:1789683846.379077:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:3.0:1789683846.387684:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683846.387853:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835556224 00000100:00100000:2.0:1789683846.387863:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835556224 00000100:00100000:2.0:1789683846.388049:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:2.0:1789683846.388062:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+9:18734:x1876618835556224:12345-192.168.201.50@tcp:700:lfs.0 00000100:00100000:2.0:1789683846.388165:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+9:18734:x1876618835556224:12345-192.168.201.50@tcp:700:lfs.0 Request processed in 105us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683846.388172:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789683846.390403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683846.390529:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835556480 00000100:00100000:2.0:1789683846.390538:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835556480 00000100:00100000:2.0:1789683846.390593:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:2.0:1789683846.390602:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+9:18734:x1876618835556480:12345-192.168.201.50@tcp:36:lfs.0 00010000:00010000:2.0:1789683846.390657:0:25531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683846.390682:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88b5bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcb56 expref: 9 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.390698:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:2.0:1789683846.390703:0:25531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683846.390758:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.390773:0:25531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbc6 expref: 5 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.390825:0:25531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.390859:0:25531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbc6 expref: 5 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.390874:0:25531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbc6 expref: 5 pid: 22767 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683846.390905:0:25531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25531:1876618850356224:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683846.390980:0:25531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720180 going to sleep for 11 seconds 00000100:00100000:2.0:1789683846.395728:0:25531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25531:1876618850356224:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683846.395761:0:25531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683846.397436:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.397525:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835556608 00000100:00100000:0.0:1789683846.397535:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835556608 00010000:00010000:0.0:1789683846.397600:0:22752:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbc6 expref: 6 pid: 22767 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683846.397639:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:0.0:1789683846.397649:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:2402:x1876618835556608:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683846.397664:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683846.397671:0:22752:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbc6 expref: 6 pid: 22767 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.397685:0:22752:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbc6 expref: 6 pid: 22767 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.397707:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b5fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbc6 expref: 6 pid: 22767 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.397723:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:0.0:1789683846.397729:0:22752:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.397739:0:22752:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.397761:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.397817:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683846.397870:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2402:x1876618835556608:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 221us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683846.397877:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00010000:00010000:2.0:1789683846.397952:0:25531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.397970:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.397994:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.398003:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.398011:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789683846.398360:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789683846.402627:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.402652:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.402665:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683846.402722:0:25531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e49b388b reply state 00000000179c9a71 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.402735:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.402743:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:3.0:1789683846.402746:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683846.402751:0:25531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789683846.402757:0:25531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789683846.402766:0:25531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.402773:0:25531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.402779:0:25531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.402911:0:25531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683846.402916:0:25531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.402925:0:25531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.402935:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:3.0:1789683846.402937:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683846.402942:0:25531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.402968:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b6a4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683846.402993:0:25531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e49b388b reply state 00000000179c9a71 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.403002:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.403009:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0f853e3900) 00010000:00010000:3.0:1789683846.403011:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683846.403014:0:25531:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789683846.403176:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+10:18734:x1876618835556480:12345-192.168.201.50@tcp:36:lfs.0 Request processed in 12568us (12774us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789683846.403185:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:3.0:1789683846.481607:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.481719:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835556736 00000100:00100000:0.0:1789683846.481731:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835556736 00000100:00100000:0.0:1789683846.481834:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:0.0:1789683846.481845:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+10:18742:x1876618835556736:12345-192.168.201.50@tcp:101:lctl.0 00010000:00010000:0.0:1789683846.481869:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683846.481893:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b6b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcbf0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.481967:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1600/0xcf8485587b88b6c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.481981:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1600/0xcf8485587b88b6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.481992:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1600/0xcf8485587b88b6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683846.482037:0:22768:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789683846.482041:0:22768:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683846.482081:0:22768:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1600/0xcf8485587b88b6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.482131:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b6b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbf0 expref: 12 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.482150:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1600/0xcf8485587b88b6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbf0 expref: 11 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.482160:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2500) 00010000:00010000:0.0:1789683846.482163:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683846.482167:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e1600, rc 0) 00000100:00100000:0.0:1789683846.482242:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+11:18742:x1876618835556736:12345-192.168.201.50@tcp:101:lctl.0 Request processed in 399us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683846.482250:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:1.0:1789683846.519041:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.519664:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835556864 00000100:00100000:0.0:1789683846.519674:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835556864 00000100:00100000:0.0:1789683846.519741:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:0.0:1789683846.519753:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:18743:x1876618835556864:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683846.519775:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683846.519834:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b6c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcbf7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.519901:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1000/0xcf8485587b88b6ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.519914:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1000/0xcf8485587b88b6ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.519927:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1000/0xcf8485587b88b6ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683846.519997:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789683846.520000:0:22766:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683846.520021:0:22766:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1000/0xcf8485587b88b6ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.520045:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b6c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbf7 expref: 7 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.520064:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1000/0xcf8485587b88b6ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbf7 expref: 6 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.520072:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2500) 00010000:00010000:0.0:1789683846.520074:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683846.520078:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e1000, rc 0) 00000100:00100000:0.0:1789683846.520143:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:18743:x1876618835556864:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 393us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683846.520149:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:3.0:1789683846.522867:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.523023:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835556992 00000100:00100000:0.0:1789683846.523032:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835556992 00000100:00100000:0.0:1789683846.523091:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:0.0:1789683846.523101:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:18743:x1876618835556992:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683846.523123:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683846.523143:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0e00/0xcf8485587b88b6d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcbfe expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523197:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b6dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523226:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b6dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523238:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b6dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523260:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523268:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523275:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523359:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b6ea lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523368:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b6ea lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523375:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b6ea lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683846.523410:0:22768:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789683846.523413:0:22768:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683846.523443:0:22768:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b6ea lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523462:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b6dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523480:0:22768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b6dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523487:0:22768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b6dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523492:0:22768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e0c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683846.523497:0:22768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b6dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523505:0:22768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b6dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523516:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2500) 00010000:00010000:0.0:1789683846.523518:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683846.523523:0:22768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b6dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523530:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b6dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523544:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523549:0:22768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523554:0:22768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523558:0:22768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e1800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683846.523567:0:22768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523573:0:22768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523580:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0f853e3900) 00010000:00010000:0.0:1789683846.523582:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683846.523585:0:22768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523591:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523620:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0e00/0xcf8485587b88b6d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbfe expref: 8 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523636:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b6ea lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbfe expref: 7 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.523644:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:0.0:1789683846.523646:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683846.523649:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0800, rc 0) 00000100:00100000:0.0:1789683846.523717:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+7:18743:x1876618835556992:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 619us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683846.523724:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:1.0:1789683846.527419:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683846.527526:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835557120 00000100:00100000:2.0:1789683846.527540:0:22777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835557120 00000100:00100000:2.0:1789683846.527641:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:2.0:1789683846.527659:0:22777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:18743:x1876618835557120:12345-192.168.201.50@tcp:900:lfs.0 00000100:00100000:2.0:1789683846.527756:0:22777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:18743:x1876618835557120:12345-192.168.201.50@tcp:900:lfs.0 Request processed in 103us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683846.527780:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00080000:1.0:1789683846.528746:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683846.534367:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.534475:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835557376 00000100:00100000:0.0:1789683846.534486:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835557376 00000100:00100000:0.0:1789683846.534545:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:0.0:1789683846.534557:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+7:18743:x1876618835557376:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683846.534603:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683846.534624:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0e00/0xcf8485587b88b6f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc05 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683846.534729:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789683846.534881:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0e00/0xcf8485587b88b6f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc05 expref: 9 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.534894:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2500) 00010000:00010000:0.0:1789683846.534897:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683846.534902:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0e00/0xcf8485587b88b6f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc05 expref: 9 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.534918:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0e00, rc 0) 00000100:00100000:0.0:1789683846.534979:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+8:18743:x1876618835557376:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 425us (624us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1789683846.534987:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:3.0:1789683846.539206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.539301:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835557632 00000100:00100000:0.0:1789683846.539312:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835557632 00000100:00100000:0.0:1789683846.539397:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:0.0:1789683846.539408:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+8:18743:x1876618835557632:12345-192.168.201.50@tcp:36:lfs.0 00010000:00010000:0.0:1789683846.539490:0:22768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683846.539522:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b6ea lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcbfe expref: 8 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.539544:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:0.0:1789683846.539548:0:22768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683846.539595:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.539614:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.539626:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683846.540072:0:22768:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001472b39a reply state 000000001552f415 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.540096:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.540103:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:0.0:1789683846.540106:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789683846.540109:0:22768:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789683846.540120:0:22768:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789683846.540259:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+9:18743:x1876618835557632:12345-192.168.201.50@tcp:36:lfs.0 Request processed in 852us (1063us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789683846.540271:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:1.0:1789683846.547881:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683846.548075:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835557888 00000100:00100000:3.0:1789683846.548089:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835557888 00000100:00100000:3.0:1789683846.548172:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:3.0:1789683846.548187:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+9:18743:x1876618835557888:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683846.548620:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+10:18743:x1876618835557888:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 435us (748us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789683846.548628:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:1.0:1789683846.552181:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.552314:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835558144 00000100:00100000:0.0:1789683846.552324:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835558144 00000100:00100000:0.0:1789683846.552577:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:0.0:1789683846.552589:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+10:18743:x1876618835558144:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683846.552615:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683846.552638:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc0c expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.552707:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b70d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.552732:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b70d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.552745:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b70d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.552757:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b714 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.552764:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.552770:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683846.552896:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789683846.552982:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b70d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.552990:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b70d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.552998:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b70d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553005:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e1a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683846.553010:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b70d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553019:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b70d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553040:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2500) 00010000:00010000:0.0:1789683846.553044:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683846.553049:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b70d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553055:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b70d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553068:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553074:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b714 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553080:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b714 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553084:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e1200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683846.553087:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b714 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553092:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b714 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553098:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0f853e3900) 00010000:00010000:0.0:1789683846.553100:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683846.553103:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b714 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553108:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b714 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553147:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b706 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc0c expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553157:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2500) 00010000:00010000:0.0:1789683846.553160:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683846.553163:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc0c expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.553172:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0c00, rc 0) 00000100:00100000:0.0:1789683846.553348:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+11:18743:x1876618835558144:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 752us (1168us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1789683846.553355:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:0.0:1789683846.557057:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683846.557146:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835558272 00000100:00100000:2.0:1789683846.557156:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835558272 00000100:00100000:2.0:1789683846.557310:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:2.0:1789683846.557322:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+11:18743:x1876618835558272:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683846.557416:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683846.557569:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b722 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc13 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.557666:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.557681:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.557693:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683846.557717:0:22768:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789683846.557721:0:22768:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683846.557742:0:22768:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.557767:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b722 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc13 expref: 13 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.557857:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc13 expref: 12 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683846.557884:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:2.0:1789683846.557887:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683846.557890:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31c00, rc 0) 00000100:00100000:2.0:1789683846.558004:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+12:18743:x1876618835558272:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 684us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683846.558012:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:1.0:1789683846.564649:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.564755:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835558400 00000100:00100000:0.0:1789683846.564767:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835558400 00000100:00100000:0.0:1789683846.564977:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:0.0:1789683846.564989:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+12:18743:x1876618835558400:12345-192.168.201.50@tcp:37:lfs.0 00000100:00100000:2.0:1789683846.570117:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+12:18743:x1876618835558400:12345-192.168.201.50@tcp:37:lfs.0 Request processed in 5117us (5465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683846.570138:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:0.0:1789683846.574239:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683846.574521:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835558656 00000100:00100000:3.0:1789683846.574531:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835558656 00000100:00100000:3.0:1789683846.574645:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:3.0:1789683846.574656:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+12:18743:x1876618835558656:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683846.574993:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+13:18743:x1876618835558656:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 338us (763us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1789683846.575001:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:1.0:1789683846.627324:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683846.627593:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835558784 00000100:00100000:3.0:1789683846.627605:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835558784 00000100:00100000:3.0:1789683846.627670:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:3.0:1789683846.627681:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+11:18749:x1876618835558784:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683846.627703:0:25531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683846.627724:0:25531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b730 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc1a expref: -99 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.627822:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b737 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.627836:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b737 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.627848:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b737 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.627859:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b73e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.627867:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b73e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.627873:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b73e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.627975:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2c00/0xcf8485587b88b745 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.627985:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2c00/0xcf8485587b88b745 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.627993:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2c00/0xcf8485587b88b745 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683846.628026:0:25531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789683846.628030:0:25531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683846.628068:0:25531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2c00/0xcf8485587b88b745 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628080:0:25531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b737 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628087:0:25531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b737 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628094:0:25531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b737 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628100:0:25531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683846.628105:0:25531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b737 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628113:0:25531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b737 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628124:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2500) 00010000:00010000:3.0:1789683846.628133:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683846.628138:0:25531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b737 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628145:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b737 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628160:0:25531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b73e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628166:0:25531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b73e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628172:0:25531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b73e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628176:0:25531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683846.628180:0:25531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b73e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628185:0:25531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b73e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628192:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0f853e3900) 00010000:00010000:3.0:1789683846.628194:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683846.628197:0:25531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b73e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628202:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b73e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628228:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b730 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc1a expref: 13 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628255:0:25531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2c00/0xcf8485587b88b745 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc1a expref: 12 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.628262:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:3.0:1789683846.628264:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789683846.628267:0:25531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c2c00, rc 0) 00000100:00100000:3.0:1789683846.628328:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+12:18749:x1876618835558784:12345-192.168.201.50@tcp:101:bash.0 Request processed in 648us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683846.628408:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:1.0:1789683846.632293:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683846.632400:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835558912 00000100:00100000:2.0:1789683846.632411:0:22777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835558912 00000100:00100000:2.0:1789683846.632483:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:2.0:1789683846.632494:0:22777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:18749:x1876618835558912:12345-192.168.201.50@tcp:900:bash.0 00000100:00100000:2.0:1789683846.632597:0:22777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:18749:x1876618835558912:12345-192.168.201.50@tcp:900:bash.0 Request processed in 105us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683846.632605:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:1.0:1789683846.636206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683846.636286:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835559168 00000100:00100000:3.0:1789683846.636305:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835559168 00000100:00100000:3.0:1789683846.636378:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:3.0:1789683846.636390:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+12:18749:x1876618835559168:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683846.636414:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683846.636446:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b74c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc21 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.636555:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.636571:0:22767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc13 expref: 12 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.636579:0:22767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.636613:0:22767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc13 expref: 12 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.636640:0:22767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc13 expref: 12 pid: 22768 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683846.636654:0:22767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22767:1876618850356352:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789683846.636735:0:22767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e844f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683846.639869:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.639962:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835559296 00000100:00100000:0.0:1789683846.639972:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835559296 00010000:00010000:0.0:1789683846.640010:0:22753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc13 expref: 13 pid: 22768 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683846.640056:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:0.0:1789683846.640068:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+13:2402:x1876618835559296:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683846.640102:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683846.640109:0:22753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc13 expref: 13 pid: 22768 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.640121:0:22753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc13 expref: 13 pid: 22768 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.640143:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:0.0:1789683846.640148:0:22753:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.640158:0:22753:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.640166:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.640185:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683846.640243:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+13:2402:x1876618835559296:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 177us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683846.640258:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00010000:00010000:3.0:1789683846.640764:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b729 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc13 expref: 12 pid: 22768 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683846.640822:0:22767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22767:1876618850356352:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683846.640847:0:22767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.640856:0:22767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.640862:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.640920:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.640931:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.640940:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.641875:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b761 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.641903:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b761 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.641912:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b761 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683846.641928:0:22767:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789683846.641966:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.641974:0:22767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.641982:0:22767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.641988:0:22767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683846.641992:0:22767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.641999:0:22767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.642010:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:3.0:1789683846.642014:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683846.642018:0:22767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.642025:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b753 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683846.642037:0:22767:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d039a2be reply state 00000000d38f8889 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.642056:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.642062:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f0e81f6da00) 00010000:00010000:3.0:1789683846.642064:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683846.642066:0:22767:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789683846.642100:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b74c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc21 expref: 15 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.642113:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b761 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc21 expref: 14 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.642121:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:3.0:1789683846.642122:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789683846.642125:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c3800, rc 0) 00000100:00100000:3.0:1789683846.642232:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+15:18749:x1876618835559168:12345-192.168.201.50@tcp:101:bash.0 Request processed in 5845us (6035us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1789683846.642250:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:1.0:1789683846.656061:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683846.656525:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835559424 00000100:00100000:3.0:1789683846.656536:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835559424 00000100:00100000:3.0:1789683846.656644:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:3.0:1789683846.656654:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+15:18749:x1876618835559424:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683846.656677:0:25531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683846.656697:0:25531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b76f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc28 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.656763:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b776 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.656815:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b776 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.656828:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b776 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683846.656878:0:25531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789683846.656882:0:25531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683846.656899:0:25531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b776 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.656909:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b776 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.656934:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b76f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc28 expref: 17 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.656953:0:25531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b776 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc28 expref: 16 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.656973:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:3.0:1789683846.656976:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683846.656980:0:25531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c3e00, rc 0) 00000100:00100000:3.0:1789683846.657043:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+16:18749:x1876618835559424:12345-192.168.201.50@tcp:101:bash.0 Request processed in 391us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683846.657050:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:2.0:1789683846.660273:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683846.660359:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835559680 00000100:00100000:3.0:1789683846.660369:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835559680 00000100:00100000:3.0:1789683846.660438:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:3.0:1789683846.660463:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+16:18749:x1876618835559680:12345-192.168.201.50@tcp:35:bash.0 00000001:00080000:3.0:1789683846.660670:0:22769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:3.0:1789683846.660771:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+18:18749:x1876618835559680:12345-192.168.201.50@tcp:35:bash.0 Request processed in 309us (507us total) trans 12884901898 rc 0/0 00000100:00100000:3.0:1789683846.660780:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000020:00080000:3.0:1789683846.660807:0:22769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1789683846.687669:0:23519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789683846.758838:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.758941:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835559936 00000100:00100000:0.0:1789683846.758963:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835559936 00000100:00100000:0.0:1789683846.759024:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:0.0:1789683846.759036:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+18:18759:x1876618835559936:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683846.759063:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683846.759085:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b77d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc2f expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683846.759209:0:22768:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789683846.759321:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b77d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc2f expref: 20 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.759334:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2500) 00010000:00010000:0.0:1789683846.759338:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683846.759351:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b77d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc2f expref: 20 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.759367:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0c00, rc 0) 00000100:00100000:0.0:1789683846.759614:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+19:18759:x1876618835559936:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 580us (785us total) trans 12884901899 rc 301/301 00000100:00100000:0.0:1789683846.759622:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:2.0:1789683846.764687:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683846.764820:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835560192 00000100:00100000:3.0:1789683846.764833:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835560192 00000100:00100000:3.0:1789683846.764901:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:3.0:1789683846.764913:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+19:18759:x1876618835560192:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683846.765145:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+20:18759:x1876618835560192:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 234us (466us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1789683846.765154:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:2.0:1789683846.825284:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.825399:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835560448 00000100:00100000:0.0:1789683846.825409:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835560448 00000100:00100000:0.0:1789683846.825482:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:0.0:1789683846.825492:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+20:18762:x1876618835560448:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683846.825518:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683846.825538:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b78b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc36 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.825650:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b792 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.825664:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b792 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.825689:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b792 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683846.825714:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789683846.825846:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b78b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc36 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.825866:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b792 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc36 expref: 22 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.825875:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683846.825878:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683846.825881:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e1200, rc 0) 00000100:00100000:0.0:1789683846.825941:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+22:18762:x1876618835560448:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 451us (667us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1789683846.825948:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:2.0:1789683846.835753:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683846.835855:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683846.835961:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835560704 00000100:00100000:0.0:1789683846.835972:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835560704 00000100:00100000:0.0:1789683846.836045:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:0.0:1789683846.836056:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+22:2405:x1876618835560704:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683846.836071:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683846.836095:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b792 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc36 expref: 22 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683846.836114:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683846.836119:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683846.836192:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+21:2405:x1876618835560704:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 138us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683846.836200:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789683846.837891:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835560576 00000100:00100000:3.0:1789683846.837902:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835560576 00000100:00100000:3.0:1789683846.837971:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:3.0:1789683846.837981:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+21:18762:x1876618835560576:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:3.0:1789683846.838046:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7a0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.838063:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.838074:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.838109:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.838131:0:22767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7a0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.838138:0:22767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7a0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.838144:0:22767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683846.838148:0:22767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7a0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.838156:0:22767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7a0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.838167:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:3.0:1789683846.838170:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683846.838175:0:22767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7a0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683846.838181:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7a0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683846.838268:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+21:18762:x1876618835560576:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 289us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683846.838276:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:2.0:1789683846.844537:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683846.844661:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835560960 00000100:00100000:3.0:1789683846.844671:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835560960 00000100:00100000:3.0:1789683846.844740:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789683846.844751:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+21:18762:x1876618835560960:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683846.845019:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+22:18762:x1876618835560960:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 270us (490us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1789683846.845041:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000040:00080000:0.0:1789683847.007488:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789683847.292562:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683847.292748:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835561216 00000100:00100000:0.0:1789683847.292759:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835561216 00000100:00100000:0.0:1789683847.292857:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:0.0:1789683847.292867:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+22:18793:x1876618835561216:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:0.0:1789683847.292893:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683847.292916:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b7a7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc3d expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683847.293031:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b7ae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683847.293046:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b7ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683847.293060:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b7ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683847.293072:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789683847.293179:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b7a7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc3d expref: 25 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683847.293197:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b7ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc3d expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683847.293205:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683847.293220:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683847.293224:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0c00, rc 0) 00000100:00100000:0.0:1789683847.293287:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+24:18793:x1876618835561216:12345-192.168.201.50@tcp:101:cat.0 Request processed in 422us (733us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1789683847.293294:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:2.0:1789683847.297734:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683847.297975:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835561472 00000100:00100000:3.0:1789683847.297989:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835561472 00000100:00100000:3.0:1789683847.298048:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:3.0:1789683847.298058:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+24:18793:x1876618835561472:12345-192.168.201.50@tcp:35:cat.0 00000100:00100000:3.0:1789683847.298350:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+25:18793:x1876618835561472:12345-192.168.201.50@tcp:35:cat.0 Request processed in 292us (623us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1789683847.298357:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:2.0:1789683847.307763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683847.307899:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835561600 00000100:00100000:1.0:1789683847.307909:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835561600 00000100:00100000:1.0:1789683847.307984:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:1.0:1789683847.307995:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+25:2405:x1876618835561600:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683847.308011:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683847.308037:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b7ae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc3d expref: 25 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.308058:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:1.0:1789683847.308062:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683847.308118:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+24:2405:x1876618835561600:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 126us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683847.308126:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00010000:00010000:3.0:1789683847.327727:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683847.399597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683847.399697:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835561856 00000100:00100000:3.0:1789683847.399708:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835561856 00000100:00100000:3.0:1789683847.399777:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:3.0:1789683847.399813:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+24:18799:x1876618835561856:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:3.0:1789683847.399840:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683847.399874:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7bc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc44 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683847.400119:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b7c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683847.400134:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b7c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683847.400146:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b7c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683847.400158:0:22767:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789683847.400317:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7bc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc44 expref: 27 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683847.400337:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b7c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc44 expref: 26 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683847.400347:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:3.0:1789683847.400350:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683847.400353:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c3200, rc 0) 00000100:00100000:3.0:1789683847.400582:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+26:18799:x1876618835561856:12345-192.168.201.50@tcp:101:dd.0 Request processed in 795us (995us total) trans 12884901905 rc 0/0 00000100:00100000:3.0:1789683847.400590:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:2.0:1789683847.409229:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683847.409337:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835561984 00000100:00100000:0.0:1789683847.409348:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835561984 00000100:00100000:0.0:1789683847.409417:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:0.0:1789683847.409427:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+26:18799:x1876618835561984:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:0.0:1789683847.409600:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683847.409624:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b7d1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc4b expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683847.409660:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b7d8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683847.409675:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b7d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683847.409687:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b7d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683847.409842:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b7d1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc4b expref: 28 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683847.410005:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b7d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc4b expref: 27 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683847.410015:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683847.410024:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789683847.410028:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e1a00, rc 0) 00000100:00100000:0.0:1789683847.410091:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+27:18799:x1876618835561984:12345-192.168.201.50@tcp:101:dd.0 Request processed in 665us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683847.410099:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:2.0:1789683847.413088:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683847.413419:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835562240 00000100:00100000:3.0:1789683847.413430:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835562240 00000100:00100000:3.0:1789683847.413494:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:3.0:1789683847.413504:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+27:18799:x1876618835562240:12345-192.168.201.50@tcp:36:dd.0 00010000:00010000:3.0:1789683847.413556:0:22767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789683847.413583:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b7c3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc44 expref: 27 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683847.413604:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b776 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc28 expref: 26 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683847.413613:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:3.0:1789683847.413617:0:22767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683847.418180:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683847.418225:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683847.418237:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683847.418332:0:22767:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:3.0:1789683847.418386:0:22767:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd38df07 reply state 000000002580fe66 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683847.418398:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683847.418405:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:3.0:1789683847.418408:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683847.418413:0:22767:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683847.418541:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+28:18799:x1876618835562240:12345-192.168.201.50@tcp:36:dd.0 Request processed in 5034us (5458us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1789683847.418550:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 45 00000020:00080000:3.0:1789683847.418556:0:22767:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789683847.593276:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683847.593679:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835562496 00000100:00100000:3.0:1789683847.593690:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835562496 00000100:00100000:3.0:1789683847.593753:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:3.0:1789683847.593765:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+28:18799:x1876618835562496:12345-192.168.201.50@tcp:35:dd.0 00000100:00100000:3.0:1789683847.594069:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+29:18799:x1876618835562496:12345-192.168.201.50@tcp:35:dd.0 Request processed in 306us (802us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1789683847.594077:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:0.0:1789683847.986009:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683847.986227:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835562624 00000100:00100000:1.0:1789683847.986237:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835562624 00000100:00100000:1.0:1789683847.986302:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:1.0:1789683847.986314:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+29:18813:x1876618835562624:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:1.0:1789683847.986341:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683847.986366:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88b7e6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc52 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986642:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b7ed lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986657:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b7ed lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986671:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b7ed lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986682:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b7f4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986689:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b7f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986695:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b7f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986777:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b7fb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986816:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b7fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986824:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b7fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683847.986870:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789683847.986875:0:22766:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683847.986925:0:22766:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b7fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986958:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b7fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986967:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b7ed lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986974:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b7ed lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986980:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b7ed lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986986:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683847.986990:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b7ed lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.986997:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b7ed lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987008:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:1.0:1789683847.987012:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683847.987016:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b7ed lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987022:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b7ed lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987034:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b7f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987040:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b7f4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987051:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b7f4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987056:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683847.987059:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b7f4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987065:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b7f4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987072:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f0e81f6da00) 00010000:00010000:1.0:1789683847.987075:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683847.987077:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b7f4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987082:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b7f4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987108:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88b7e6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc52 expref: 31 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987121:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b7fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc52 expref: 30 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683847.987127:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:1.0:1789683847.987129:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683847.987131:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8c00, rc 0) 00000100:00100000:1.0:1789683847.987195:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+30:18813:x1876618835562624:12345-192.168.201.50@tcp:101:stat.0 Request processed in 884us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683847.987210:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:2.0:1789683848.110344:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683848.110474:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835562880 00000100:00100000:0.0:1789683848.110486:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835562880 00000100:00100000:0.0:1789683848.110560:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:0.0:1789683848.110571:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+30:18819:x1876618835562880:12345-192.168.201.50@tcp:36:truncate.0 00010000:00010000:0.0:1789683848.110629:0:22768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683848.110656:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b7fb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc52 expref: 30 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.110675:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683848.110680:0:22768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683848.110940:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.110954:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.110963:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683848.111005:0:22768:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901909 00000100:00080000:1.0:1789683848.111349:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1789683848.111547:0:22768:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7b7f23f reply state 000000006eaf538d transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.111561:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.111584:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683848.111587:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789683848.111590:0:22768:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683848.111919:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+32:18819:x1876618835562880:12345-192.168.201.50@tcp:36:truncate.0 Request processed in 1348us (1584us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1789683848.111927:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 47 00000020:00080000:0.0:1789683848.111942:0:22768:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789683848.287119:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683848.287141:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850356480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683848.287222:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683848.287302:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850356480 00000100:00100000:2.0:1789683848.287311:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850356480 00000100:00100000:2.0:1789683848.287378:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683848.287398:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850356480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683848.287432:0:24280:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683848.287486:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850356480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683848.287493:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683848.287540:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850356480:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789683848.287837:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789683848.351863:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683848.394894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683848.394999:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835563008 00000100:00100000:1.0:1789683848.395011:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835563008 00000100:00100000:1.0:1789683848.395087:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:1.0:1789683848.395098:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+32:18833:x1876618835563008:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:1.0:1789683848.395127:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683848.395148:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88b809 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc59 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395216:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b810 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395231:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b810 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395241:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b810 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395251:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b817 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395259:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b817 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395265:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b817 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395339:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395368:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395376:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683848.395426:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1789683848.395431:0:22766:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683848.395462:0:22766:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395475:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395485:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b810 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395491:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b810 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395497:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b810 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395502:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683848.395506:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b810 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395513:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b810 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395523:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:1.0:1789683848.395532:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683848.395537:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b810 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395543:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9a00/0xcf8485587b88b810 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395557:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b817 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395563:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b817 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395569:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b817 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395574:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683848.395576:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b817 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395582:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b817 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395589:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f0e81f6da00) 00010000:00010000:1.0:1789683848.395591:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683848.395594:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b817 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395600:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9e00/0xcf8485587b88b817 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395624:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88b809 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc59 expref: 34 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395650:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc59 expref: 33 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683848.395657:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:1.0:1789683848.395659:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683848.395661:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8c00, rc 0) 00000100:00100000:1.0:1789683848.395726:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+33:18833:x1876618835563008:12345-192.168.201.50@tcp:101:stat.0 Request processed in 630us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683848.395733:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:2.0:1789683848.575755:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683848.576140:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835563264 00000100:00100000:0.0:1789683848.576154:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835563264 00000100:00100000:0.0:1789683848.576228:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:0.0:1789683848.576239:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+33:18843:x1876618835563264:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683848.576261:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683848.576282:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b825 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc60 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683848.576395:0:22767:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789683848.576492:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b825 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc60 expref: 35 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.576508:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2500) 00010000:00010000:0.0:1789683848.576511:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683848.576517:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b825 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc60 expref: 35 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.576545:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0a00, rc 0) 00000100:00100000:0.0:1789683848.576620:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+34:18843:x1876618835563264:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 383us (875us total) trans 12884901911 rc 301/301 00000100:00100000:0.0:1789683848.576627:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:2.0:1789683848.598099:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683848.598477:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835563520 00000100:00100000:3.0:1789683848.598500:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835563520 00000100:00100000:3.0:1789683848.598559:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:3.0:1789683848.598573:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+34:18843:x1876618835563520:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683848.598871:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+35:18843:x1876618835563520:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 300us (782us total) trans 12884901912 rc 0/0 00000100:00100000:3.0:1789683848.598880:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:1.0:1789683848.707375:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683848.707544:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835563776 00000100:00100000:0.0:1789683848.707557:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835563776 00000100:00100000:0.0:1789683848.707632:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:0.0:1789683848.707643:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+35:18849:x1876618835563776:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789683848.707667:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683848.707687:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b833 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc67 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.707829:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.707846:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b761 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc21 expref: 36 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.707855:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc59 expref: 36 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.707863:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.707897:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc59 expref: 36 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.707975:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc59 expref: 36 pid: 22766 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683848.707989:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7def100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22766:1876618850356608:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683848.708092:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b761 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc21 expref: 36 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.708101:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b761 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc21 expref: 36 pid: 22767 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683848.708111:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22766:1876618850356736:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683848.708135:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683848.712244:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7def100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22766:1876618850356608:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683848.712260:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22766:1876618850356736:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683848.712286:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683848.720654:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683848.720719:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683848.720823:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835563904 00000100:00100000:2.0:1789683848.720833:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835563904 00010000:00010000:2.0:1789683848.720875:0:22752:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc59 expref: 37 pid: 22766 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683848.720910:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835564032 00000100:00100000:2.0:1789683848.720913:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835564032 00010000:00010000:2.0:1789683848.720937:0:22752:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b761 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc21 expref: 38 pid: 22767 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683848.720974:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:2.0:1789683848.720983:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+38:2404:x1876618835563904:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683848.720999:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683848.721007:0:22752:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc59 expref: 38 pid: 22766 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.721019:0:22752:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc59 expref: 38 pid: 22766 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.721041:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8c00/0xcf8485587b88b81e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc59 expref: 38 pid: 22766 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.721057:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:2.0:1789683848.721062:0:22752:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.721071:0:22752:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.721076:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683848.721135:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+37:2404:x1876618835563904:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 152us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683848.721142:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:2.0:1789683848.721161:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:2.0:1789683848.721169:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7958450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+36:2404:x1876618835564032:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683848.721187:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683848.721193:0:22752:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b761 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc21 expref: 36 pid: 22767 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.721216:0:22752:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b761 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc21 expref: 36 pid: 22767 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.721230:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3800/0xcf8485587b88b761 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc21 expref: 36 pid: 22767 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.721240:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:2.0:1789683848.721244:0:22752:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.721252:0:22752:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.721260:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.721287:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683848.721309:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7958450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+35:2404:x1876618835564032:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 141us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683848.721315:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00010000:00010000:0.0:1789683848.722000:0:22766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.722012:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683848.722032:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1789683848.722173:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b833 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc67 expref: 36 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.722213:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc67 expref: 35 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.722222:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683848.722225:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683848.722228:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0400, rc 0) 00000100:00100000:0.0:1789683848.722265:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+35:18849:x1876618835563776:12345-192.168.201.50@tcp:101:bash.0 Request processed in 14623us (14898us total) trans 12884901913 rc 0/0 00000100:00100000:0.0:1789683848.722272:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:2.0:1789683848.747886:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683848.747997:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835564288 00000100:00100000:0.0:1789683848.748009:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835564288 00000100:00100000:0.0:1789683848.748075:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:0.0:1789683848.748086:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+35:18849:x1876618835564288:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:0.0:1789683848.748333:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.748351:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.748363:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683848.748418:0:22767:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000004:00010000:0.0:1789683848.748442:0:22767:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7153a9e reply state 0000000072db5b01 transno 12884901915 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.748455:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.748481:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683848.748484:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789683848.748488:0:22767:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683848.748582:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+38:18849:x1876618835564288:12345-192.168.201.50@tcp:36:bash.0 Request processed in 498us (706us total) trans 12884901915 rc 0/0 00000100:00100000:0.0:1789683848.748590:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 51 00000020:00080000:0.0:1789683848.748595:0:22767:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789683848.751123:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683848.751318:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835564416 00000100:00100000:3.0:1789683848.751330:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835564416 00000100:00100000:3.0:1789683848.751397:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:3.0:1789683848.751407:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+38:18849:x1876618835564416:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683848.751433:0:25531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683848.751463:0:25531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b84f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc6e expref: -99 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683848.751516:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b84f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc6e expref: 39 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683848.751530:0:25531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b84f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc6e expref: 39 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683848.751549:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:3.0:1789683848.751552:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683848.751555:0:25531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c3e00, rc 0) 00000100:00100000:3.0:1789683848.751620:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+39:18849:x1876618835564416:12345-192.168.201.50@tcp:101:bash.0 Request processed in 214us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683848.751627:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:1.0:1789683848.777496:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683848.777652:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835564544 00000100:00100000:0.0:1789683848.777665:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835564544 00000100:00100000:0.0:1789683848.777735:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:0.0:1789683848.777744:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+39:18849:x1876618835564544:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789683848.777768:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683848.777819:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1e00/0xcf8485587b88b856 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc75 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.777914:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b85d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.777939:0:22767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc67 expref: 40 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.777949:0:22767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b85d lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.777983:0:22767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc67 expref: 40 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.777997:0:22767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc67 expref: 40 pid: 22766 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683848.778027:0:22767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22767:1876618850356864:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683848.778113:0:22767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683848.782399:0:22767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22767:1876618850356864:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683848.782432:0:22767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b85d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683848.782854:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683848.782952:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835564672 00000100:00100000:2.0:1789683848.782960:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835564672 00010000:00010000:2.0:1789683848.782998:0:22752:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc67 expref: 41 pid: 22766 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683848.783056:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789683848.783066:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+41:2402:x1876618835564672:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683848.783081:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683848.783088:0:22752:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc67 expref: 41 pid: 22766 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.783101:0:22752:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc67 expref: 41 pid: 22766 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.783122:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0400/0xcf8485587b88b83a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc67 expref: 41 pid: 22766 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.783141:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:2.0:1789683848.783145:0:22752:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b85d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.783154:0:22752:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b85d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.783161:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b85d lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.783191:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683848.783252:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+40:2402:x1876618835564672:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 186us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683848.783259:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00010000:00010000:0.0:1789683848.783657:0:22767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b85d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.783666:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b85d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683848.783718:0:22767:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789683848.783723:0:22767:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683848.783741:0:22767:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b85d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.783772:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1e00/0xcf8485587b88b856 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc75 expref: 40 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.783822:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b85d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc75 expref: 39 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.783830:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683848.783833:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683848.783836:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0800, rc 0) 00000100:00100000:0.0:1789683848.783874:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+39:18849:x1876618835564544:12345-192.168.201.50@tcp:101:bash.0 Request processed in 6131us (6389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683848.783890:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:1.0:1789683848.793349:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683848.793484:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835564928 00000100:00100000:0.0:1789683848.793494:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835564928 00000100:00100000:0.0:1789683848.793565:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:0.0:1789683848.793576:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+39:18849:x1876618835564928:12345-192.168.201.50@tcp:103:bash.0 00010000:00010000:0.0:1789683848.793591:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789683848.793614:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b84f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc6e expref: 39 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.793648:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b85d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc75 expref: 38 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683848.793661:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683848.793666:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683848.793723:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+37:18849:x1876618835564928:12345-192.168.201.50@tcp:103:bash.0 Request processed in 150us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683848.793730:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:2.0:1789683848.796052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683848.796146:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835565056 00000100:00100000:3.0:1789683848.796163:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835565056 00000100:00100000:3.0:1789683848.796217:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:3.0:1789683848.796226:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+37:18849:x1876618835565056:12345-192.168.201.50@tcp:58:bash.0 00010000:00010000:3.0:1789683848.796322:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683848.796339:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683848.796350:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683848.798959:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683848.798982:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f9e834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850356992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683848.799050:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683848.799110:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850356992 00000100:00100000:1.0:1789683848.799118:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850356992 00000100:00100000:1.0:1789683848.799170:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789683848.799181:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850356992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683848.799219:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683848.799268:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850356992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683848.799284:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789683848.799330:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f9e834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850356992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683848.801271:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683848.801289:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850357120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683848.801353:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683848.801433:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850357120 00000100:00100000:2.0:1789683848.801442:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850357120 00000100:00100000:2.0:1789683848.801500:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789683848.801508:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850357120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683848.801540:0:23773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789683848.801593:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850357120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683848.801599:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789683848.801736:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850357120:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789683848.802399:0:25531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683848.802431:0:25531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1789683848.802588:0:25531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1789683848.802932:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+37:18849:x1876618835565056:12345-192.168.201.50@tcp:58:bash.0 Request processed in 6692us (6875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683848.802950:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:1.0:1789683848.808036:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683848.808149:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835565184 00000100:00100000:2.0:1789683848.808160:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835565184 00000100:00100000:2.0:1789683848.808233:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:2.0:1789683848.808243:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+37:18849:x1876618835565184:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683848.808265:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683848.808285:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b86b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc7c expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.808339:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.808349:0:22768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b86b lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc7c expref: 38 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.808367:0:22768:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.808390:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b86b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc7c expref: 38 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.808419:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:2.0:1789683848.808422:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683848.808426:0:22768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b86b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc7c expref: 38 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683848.808435:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31a00, rc 0) 00000100:00100000:2.0:1789683848.808494:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+38:18849:x1876618835565184:12345-192.168.201.50@tcp:101:bash.0 Request processed in 253us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683848.808501:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000040:00080000:0.0:1789683849.055012:0:22800:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789683849.055020:0:22800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683849.055046:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789683849.055058:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789683849.055189:0:22800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7def100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22800:1876618850357248:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789683849.055286:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683849.057961:0:22800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7def100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22800:1876618850357248:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789683849.058217:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.058396:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835565312 00000100:00100000:0.0:1789683849.058404:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835565312 00000100:00100000:0.0:1789683849.058470:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:0.0:1789683849.058482:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+38:18850:x1876618835565312:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789683849.058514:0:22766:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789683849.059905:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+38:18850:x1876618835565312:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 1421us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683849.059926:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:1.0:1789683849.067091:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.067217:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835565440 00000100:00100000:2.0:1789683849.067228:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835565440 00000100:00100000:2.0:1789683849.067292:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:2.0:1789683849.067303:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+38:18850:x1876618835565440:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789683849.067388:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b872 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067408:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b872 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067421:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b872 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067478:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b879 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067486:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b879 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067510:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b879 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067533:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b880 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067541:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b880 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067548:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b880 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683849.067589:0:22768:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789683849.067593:0:22768:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683849.067605:0:22768:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b880 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067615:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b872 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067743:0:22768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b872 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067750:0:22768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b872 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067756:0:22768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.067760:0:22768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b872 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067767:0:22768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b872 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067825:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f853e3b00) 00010000:00010000:2.0:1789683849.067828:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683849.067835:0:22768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b872 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067841:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88b872 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067855:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b879 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067861:0:22768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b879 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067867:0:22768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b879 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067873:0:22768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.067875:0:22768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b879 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067881:0:22768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b879 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067888:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9f0f853e3d00) 00010000:00010000:2.0:1789683849.067891:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683849.067894:0:22768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b879 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067899:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88b879 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067933:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b880 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067939:0:22768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b880 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067945:0:22768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b880 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067950:0:22768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.067953:0:22768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b880 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067959:0:22768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b880 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067966:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:2.0:1789683849.067968:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683849.067971:0:22768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b880 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.067977:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b880 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683849.068201:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+38:18850:x1876618835565440:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 Request processed in 898us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683849.068210:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:1.0:1789683849.070479:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.070597:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835565696 00000100:00100000:3.0:1789683849.070607:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835565696 00000100:00100000:3.0:1789683849.070769:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:3.0:1789683849.070780:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+38:18850:x1876618835565696:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683849.070829:0:25531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683849.070849:0:25531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3600/0xcf8485587b88b887 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc83 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.070962:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b88e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.070974:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b88e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.070986:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b88e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683849.070998:0:25531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789683849.071248:0:25531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b88e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.071256:0:25531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b88e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.071264:0:25531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b88e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.071269:0:25531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683849.071274:0:25531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b88e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.071281:0:25531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b88e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.071293:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:3.0:1789683849.071297:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683849.071302:0:25531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b88e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.071309:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b88e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.071350:0:25531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3600/0xcf8485587b88b887 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc83 expref: 40 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.071360:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f853e3b00) 00010000:00010000:3.0:1789683849.071362:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683849.071367:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3600/0xcf8485587b88b887 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc83 expref: 40 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.071518:0:25531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c3600, rc 0) 00000100:00100000:3.0:1789683849.071642:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+39:18850:x1876618835565696:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 863us (1171us total) trans 12884901916 rc 301/301 00000100:00100000:3.0:1789683849.071650:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:3.0:1789683849.082714:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.082923:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835565824 00000100:00100000:2.0:1789683849.082939:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835565824 00000100:00100000:2.0:1789683849.083003:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:2.0:1789683849.083028:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+39:18850:x1876618835565824:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789683849.083077:0:22768:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789683849.083233:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+39:18850:x1876618835565824:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 206us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683849.083241:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:1.0:1789683849.095098:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.095206:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835566080 00000100:00100000:0.0:1789683849.095218:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835566080 00000100:00100000:0.0:1789683849.095288:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:0.0:1789683849.095298:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+39:18850:x1876618835566080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683849.095321:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683849.095342:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b89c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc8a expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789683849.095772:0:22766:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:0.0:1789683849.095837:0:22766:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:0.0:1789683849.095860:0:22766:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:0.0:1789683849.096029:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1e00/0xcf8485587b88b8a3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.096044:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1e00/0xcf8485587b88b8a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.096055:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1e00/0xcf8485587b88b8a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.096108:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0800/0xcf8485587b88b89c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc8a expref: 42 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.096128:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1e00/0xcf8485587b88b8a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc8a expref: 41 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.096136:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2600) 00010000:00010000:0.0:1789683849.096139:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683849.096142:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e1e00, rc 0) 00000100:00100000:0.0:1789683849.096209:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+41:18850:x1876618835566080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 913us (1122us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1789683849.096218:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:1.0:1789683849.104183:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.104822:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835566336 00000100:00100000:2.0:1789683849.104834:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835566336 00000100:00100000:2.0:1789683849.104924:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:2.0:1789683849.104936:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+41:18850:x1876618835566336:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683849.105001:0:22768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683849.105026:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1e00/0xcf8485587b88b8a3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc8a expref: 41 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105049:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2600) 00010000:00010000:2.0:1789683849.105061:0:22768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683849.105085:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b8b1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105100:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b8b1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105111:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b8b1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105177:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8b8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xad62e4b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105186:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8b8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xad62e4b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105210:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8b8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xad62e4b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105257:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b8b1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105265:0:22768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b8b1 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105273:0:22768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b8b1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105280:0:22768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.105285:0:22768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b8b1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105294:0:22768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b8b1 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105302:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:2.0:1789683849.105305:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683849.105309:0:22768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b8b1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105316:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b8b1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105327:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8b8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xad62e4b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105334:0:22768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8b8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xad62e4b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105346:0:22768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8b8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xad62e4b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105352:0:22768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.105355:0:22768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8b8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xad62e4b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105362:0:22768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8b8 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xad62e4b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105371:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xad62e4b2 (ffff9f0f853e3d00) 00010000:00010000:2.0:1789683849.105374:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683849.105377:0:22768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8b8 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xad62e4b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.105383:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8b8 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xad62e4b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683849.105466:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+40:18850:x1876618835566336:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 532us (1295us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683849.105474:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:3.0:1789683849.109326:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.109661:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835566464 00000100:00100000:0.0:1789683849.109672:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835566464 00000100:00100000:0.0:1789683849.109741:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:0.0:1789683849.109751:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+40:18850:x1876618835566464:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683849.109775:0:25531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683849.109840:0:25531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b8bf lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc91 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.110185:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0e00/0xcf8485587b88b8c6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.110200:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0e00/0xcf8485587b88b8c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.110211:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0e00/0xcf8485587b88b8c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.110318:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b8bf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc91 expref: 42 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.110337:0:25531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0e00/0xcf8485587b88b8c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc91 expref: 41 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.110345:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:0.0:1789683849.110347:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789683849.110351:0:25531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0e00, rc 0) 00000100:00100000:0.0:1789683849.110415:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+41:18850:x1876618835566464:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 665us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683849.110423:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:1.0:1789683849.118578:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.119032:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835566720 00000100:00100000:2.0:1789683849.119043:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835566720 00000100:00100000:2.0:1789683849.119108:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:2.0:1789683849.119119:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+41:18850:x1876618835566720:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683849.119211:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.119228:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.119252:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683849.119407:0:22768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1789683849.119416:0:22768:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763168631755ns, next at 764168628631ns, rc = 0 00000004:00010000:2.0:1789683849.119460:0:22768:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082f40e0a reply state 00000000c01ae1b4 transno 12884901918 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.119472:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.119480:0:22768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:2.0:1789683849.119483:0:22768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789683849.119486:0:22768:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683849.119644:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+43:18850:x1876618835566720:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 525us (1074us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1789683849.119651:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:1.0:1789683849.128751:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.132715:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835566848 00000100:00100000:2.0:1789683849.132730:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835566848 00000100:00100000:2.0:1789683849.132813:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:2.0:1789683849.132823:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+43:18850:x1876618835566848:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683849.132848:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683849.132868:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2400/0xcf8485587b88b8d4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc98 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.132937:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2400/0xcf8485587b88b8d4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc98 expref: 44 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.132973:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2400/0xcf8485587b88b8d4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc98 expref: 44 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.132995:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:2.0:1789683849.132999:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683849.133003:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc2400, rc 0) 00000100:00100000:2.0:1789683849.135386:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+44:18850:x1876618835566848:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 2545us (6626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683849.135399:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:2.0:1789683849.147920:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.148136:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835566976 00000100:00100000:0.0:1789683849.148146:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835566976 00000100:00100000:0.0:1789683849.148336:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:0.0:1789683849.148347:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2403:x1876618835566976:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789683849.148600:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:2403:x1876618835566976:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 254us (896us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1789683849.148625:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00080000:1.0:1789683849.150553:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683849.152568:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.152693:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835567232 00000100:00100000:3.0:1789683849.152714:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835567232 00000100:00100000:3.0:1789683849.152769:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:3.0:1789683849.152778:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+44:18850:x1876618835567232:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789683849.153037:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+45:18850:x1876618835567232:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 259us (478us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1789683849.153044:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:3.0:1789683849.156901:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.157078:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835567488 00000100:00100000:2.0:1789683849.157092:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835567488 00000100:00100000:2.0:1789683849.157144:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:2.0:1789683849.157153:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+45:18850:x1876618835567488:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683849.157298:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+45:18850:x1876618835567488:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 146us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683849.157306:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:0.0:1789683849.166071:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.166234:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835567616 00000100:00100000:3.0:1789683849.166245:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835567616 00000100:00100000:3.0:1789683849.166306:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:3.0:1789683849.166316:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+45:18850:x1876618835567616:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683849.166336:0:25531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683849.166357:0:25531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3600/0xcf8485587b88b8db lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcc9f expref: -99 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.166441:0:25531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b8e2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.166473:0:25531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b8e2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.166485:0:25531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b8e2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683849.166529:0:25531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683849.166548:0:25531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b8e2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.166572:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3600/0xcf8485587b88b8db lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc9f expref: 47 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.166591:0:25531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b8e2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc9f expref: 46 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.166599:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:3.0:1789683849.166602:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789683849.166606:0:25531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c3e00, rc 0) 00000100:00100000:3.0:1789683849.166673:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+46:18850:x1876618835567616:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 358us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683849.166680:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:1.0:1789683849.171563:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.171654:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835567744 00000100:00100000:2.0:1789683849.171665:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835567744 00000100:00100000:2.0:1789683849.171722:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789683849.171733:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+6:2404:x1876618835567744:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683849.171753:0:24278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683849.171775:0:24278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b8e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcca6 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789683849.171856:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac6889, blocks: 0x0 00010000:00010000:2.0:1789683849.171879:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=763s v=(0 0) 00010000:00010000:2.0:1789683849.171884:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683849.171894:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b8e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcca6 expref: 7 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.171922:0:24278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b8e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcca6 expref: 7 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.171936:0:24278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc2200, rc 0) 00000100:00100000:2.0:1789683849.171988:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:2404:x1876618835567744:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 257us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683849.171995:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:1.0:1789683849.184014:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.184123:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835568000 00000100:00100000:2.0:1789683849.184134:0:22768:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835568000 00000100:00100000:2.0:1789683849.184205:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:2.0:1789683849.184214:0:22768:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+46:18850:x1876618835568000:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683849.184465:0:22768:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+46:18850:x1876618835568000:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 252us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683849.184473:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:0.0:1789683849.188251:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.188333:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835568128 00000100:00100000:3.0:1789683849.188344:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835568128 00000100:00100000:3.0:1789683849.188419:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:3.0:1789683849.188430:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+46:18850:x1876618835568128:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789683849.202830:0:22746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901919 is committed 00000004:00080000:0.0:1789683849.202856:0:22746:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789683849.202953:0:22746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1789683849.203018:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.203032:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.203040:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.203047:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e1800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683849.203051:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.203060:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.203076:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:0.0:1789683849.203079:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789683849.203084:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.203090:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1800/0xcf8485587b88b6ff lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683849.203408:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+20:18850:x1876618835568128:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 Request processed in 14975us (15162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683849.203419:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:1.0:1789683849.203983:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683849.203999:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f9e836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850357376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789683849.204055:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683849.204102:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850357376 00000100:00100000:1.0:1789683849.204111:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850357376 00000100:00100000:1.0:1789683849.204160:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789683849.204168:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850357376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789683849.204284:0:24277:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789683849.204287:0:24277:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789683849.204289:0:24277:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789683849.204291:0:24277:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789683849 -> 1789683849 00002000:00010000:1.0:1789683849.204293:0:24277:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789683849.204325:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1876618850357376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (270us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1789683849.204344:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789683849.204361:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789683849.204392:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0f9e836a00/2, rc 0, transno 12884901892 00000100:00100000:1.0:1789683849.204397:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f9e836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850357376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789683849.208718:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.208825:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835568256 00000100:00100000:3.0:1789683849.208850:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835568256 00000100:00100000:3.0:1789683849.208931:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:3.0:1789683849.208942:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:2403:x1876618835568256:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789683849.209065:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:2403:x1876618835568256:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 Request processed in 124us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683849.209072:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:0.0:1789683849.211670:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.211771:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835568512 00000100:00100000:3.0:1789683849.211780:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835568512 00000100:00100000:3.0:1789683849.211871:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:3.0:1789683849.211881:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+20:18850:x1876618835568512:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789683849.211945:0:22767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683849.211972:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b8e2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc9f expref: 20 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.211991:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:3.0:1789683849.211995:0:22767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683849.212021:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3600/0xcf8485587b88b8f0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.212034:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3600/0xcf8485587b88b8f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.212044:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3600/0xcf8485587b88b8f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683849.212163:0:22767:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000969196c6 reply state 000000005bb8e9a2 transno 12884901920 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3600/0xcf8485587b88b8f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.212174:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3600/0xcf8485587b88b8f0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.212186:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:3.0:1789683849.212188:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683849.212191:0:22767:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683849.212292:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+21:18850:x1876618835568512:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 412us (631us total) trans 12884901920 rc 0/0 00000100:00100000:3.0:1789683849.212299:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:1.0:1789683849.215369:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.215467:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835568640 00000100:00100000:0.0:1789683849.215477:0:24277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835568640 00000100:00100000:0.0:1789683849.215537:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:0.0:1789683849.215548:0:24277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:18850:x1876618835568640:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683849.215566:0:24277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683849.215585:0:24277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bccad expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.215616:0:24277:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b8e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcca6 expref: 8 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.215625:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683849.215630:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683849.215635:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 8 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.215668:0:24277:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b8e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcca6 expref: 8 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.215682:0:24277:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b8e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcca6 expref: 8 pid: 24278 timeout: 863 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683849.215696:0:24277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7deea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24277:1876618850357504:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683849.215816:0:24277:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612600 going to sleep for 11 seconds 00010000:00010000:2.0:1789683849.218312:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218334:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218341:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218348:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.218353:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218361:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218378:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f0f853e3900) 00010000:00010000:2.0:1789683849.218381:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683849.218385:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218391:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88b6ab lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218421:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218428:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218434:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218439:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.218447:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218454:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218462:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:2.0:1789683849.218465:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683849.218468:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218474:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b6b2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218492:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218497:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218503:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218508:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.218510:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218516:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218523:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f0e81f6da00) 00010000:00010000:2.0:1789683849.218526:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683849.218534:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218539:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b75a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218555:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218560:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218565:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218569:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.218571:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218576:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218583:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:2.0:1789683849.218585:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683849.218588:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218593:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b7df lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218603:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218619:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218625:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218630:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e1200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.218633:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218638:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218646:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:2.0:1789683849.218648:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683849.218651:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218656:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1200/0xcf8485587b88b802 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218666:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218671:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218677:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218681:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e0a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.218689:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218695:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218703:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:2.0:1789683849.218705:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683849.218708:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218713:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0a00/0xcf8485587b88b848 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218726:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218732:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218738:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218742:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683849.218744:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218749:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218757:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:2.0:1789683849.218759:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789683849.218768:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.218773:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2800/0xcf8485587b88b8cd lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683849.223968:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.224445:0:24277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7deea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24277:1876618850357504:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683849.224497:0:24277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 8 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.224536:0:24277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e1c00, rc 0) 00000100:00100000:0.0:1789683849.224599:0:24277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+8:18850:x1876618835568640:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 9052us (9238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683849.224609:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:3.0:1789683849.225233:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835568768 00000100:00100000:3.0:1789683849.225243:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835568768 00010000:00010000:3.0:1789683849.225279:0:22751:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b8e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcca6 expref: 8 pid: 24278 timeout: 863 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683849.225322:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:3.0:1789683849.225332:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+8:2403:x1876618835568768:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683849.225351:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683849.225384:0:22751:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b8e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcca6 expref: 8 pid: 24278 timeout: 863 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.225397:0:22751:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b8e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcca6 expref: 8 pid: 24278 timeout: 863 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.225422:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1ecd51f/0xcf8485587b88b8e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcca6 expref: 8 pid: 24278 timeout: 863 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.225438:0:22751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683849.225443:0:22751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683849.226319:0:22751:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 7 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.226331:0:22751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 7 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.227123:0:22751:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 7 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683849.227149:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22751:1876618850357632:192.168.201.50@tcp:105: 00000100:00100000:3.0:1789683849.227759:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e844f5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683849.234232:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22751:1876618850357632:192.168.201.50@tcp:105: 00010000:00010000:3.0:1789683849.234262:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683849.234329:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:2403:x1876618835568768:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 8997us (10369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683849.234341:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:0.0:1789683849.239981:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.240058:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835568896 00000100:00100000:3.0:1789683849.240069:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835568896 00000100:00100000:3.0:1789683849.240127:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:3.0:1789683849.240136:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:2403:x1876618835568896:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789683849.240297:0:24278:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789683849.240300:0:24278:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789683849 00002000:00010000:3.0:1789683849.240302:0:24278:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789683846 00002000:00010000:3.0:1789683849.240304:0:24278:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789683849 -> 1789683849 00002000:00010000:3.0:1789683849.240306:0:24278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789683849.240518:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+8:2403:x1876618835568896:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 382us (546us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789683849.240526:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:1.0:1789683849.247360:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.247480:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835569024 00000100:00100000:2.0:1789683849.247492:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835569024 00000100:00100000:2.0:1789683849.247555:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:2.0:1789683849.247565:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9e835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+8:2405:x1876618835569024:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789683849.247613:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.247631:0:24715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 8 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.247639:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683849.247644:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683849.247648:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.247681:0:24715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 8 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.247695:0:24715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 8 pid: 24277 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683849.247708:0:24715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6170380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24715:1876618850357760:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683849.247830:0:24715:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683849.254037:0:24715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6170380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24715:1876618850357760:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683849.254070:0:24715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683849.255956:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.256048:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835569152 00000100:00100000:2.0:1789683849.256057:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835569152 00010000:00010000:2.0:1789683849.256097:0:22752:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 9 pid: 24277 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683849.256138:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:2.0:1789683849.256147:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9efece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+9:2403:x1876618835569152:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683849.256161:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683849.256180:0:22752:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 9 pid: 24277 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.256193:0:22752:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 9 pid: 24277 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.256224:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d6e18e8/0xcf8485587b88b8f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccad expref: 9 pid: 24277 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.256241:0:22752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683849.256245:0:22752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683849.256251:0:22752:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.256269:0:22752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.256300:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683849.256346:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9efece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+8:2403:x1876618835569152:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 200us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683849.256353:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00010000:00010000:1.0:1789683849.256560:0:24715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.256569:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.256588:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.256597:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.256604:0:24715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.256610:0:24715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683849.256614:0:24715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.256630:0:24715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.256642:0:24715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.256649:0:24715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ad60d2c/0xcf8485587b88b8fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683849.256697:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9e835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:2405:x1876618835569024:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 Request processed in 9134us (9346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683849.256705:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:1.0:1789683849.259242:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.259319:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835569408 00000100:00100000:2.0:1789683849.259328:0:22766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835569408 00000100:00100000:2.0:1789683849.259401:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00100000:2.0:1789683849.259411:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9efedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+15:18850:x1876618835569408:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789683849.259525:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.259543:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b7d8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc4b expref: 15 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.259553:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.259588:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b7d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc4b expref: 15 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.259602:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b7d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc4b expref: 15 pid: 22766 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683849.259627:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6170380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22766:1876618850357888:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683849.259707:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683849.262306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.262416:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835569536 00000100:00100000:0.0:1789683849.262426:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835569536 00010000:00010000:0.0:1789683849.262478:0:22751:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b7d8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc4b expref: 16 pid: 22766 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683849.262515:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:0.0:1789683849.262525:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+16:2402:x1876618835569536:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683849.262540:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683849.262547:0:22751:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b7d8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc4b expref: 16 pid: 22766 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.262559:0:22751:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b7d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc4b expref: 16 pid: 22766 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.262581:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683849.262587:0:22751:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b86b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc7c expref: 16 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.262596:0:22751:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.262619:0:22751:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.262627:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.262645:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683849.262704:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+16:2402:x1876618835569536:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 180us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683849.262711:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00010000:00010000:2.0:1789683849.264085:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e1a00/0xcf8485587b88b7d8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc4b expref: 15 pid: 22766 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683849.264106:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6170380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22766:1876618850357888:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683849.264127:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.264135:0:22766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.264141:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.264335:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.264347:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2400/0xcf8485587b88b8d4 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc98 expref: 15 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.264354:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.264382:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2400/0xcf8485587b88b8d4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc98 expref: 15 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.264447:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2400/0xcf8485587b88b8d4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc98 expref: 15 pid: 22766 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683849.264472:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6170380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22766:1876618850358016:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683849.264578:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e837203c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683849.278165:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683849.279632:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835569664 00000100:00100000:1.0:1789683849.279646:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835569664 00010000:00010000:1.0:1789683849.279689:0:22753:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2400/0xcf8485587b88b8d4 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc98 expref: 16 pid: 22766 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683849.279731:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:1.0:1789683849.279740:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7deed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+16:2402:x1876618835569664:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683849.279754:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683849.279760:0:22753:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2400/0xcf8485587b88b8d4 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc98 expref: 16 pid: 22766 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.279773:0:22753:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2400/0xcf8485587b88b8d4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc98 expref: 16 pid: 22766 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.279842:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:1.0:1789683849.279847:0:22753:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.279856:0:22753:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.279864:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.279884:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683849.279943:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7deed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6dee52e-fd7e-4613-b7b8-6beab7d04952+16:2402:x1876618835569664:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 205us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683849.279950:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00010000:00010000:2.0:1789683849.288394:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2400/0xcf8485587b88b8d4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc98 expref: 15 pid: 22766 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683849.288422:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6170380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22766:1876618850358016:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683849.288445:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.288470:0:22766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683849.288477:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683849.288592:0:22766:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1789683849.288705:0:22766:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000001:00080000:2.0:1789683849.288744:0:22766:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1789683849.288837:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6170380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22766:1876618850358144:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789683849.288926:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683849.289023:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720300 going to sleep for 11 seconds 00000100:00100000:1.0:1789683849.292905:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850358144 00000100:00100000:1.0:1789683849.292932:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850358144 00000100:00100000:0.0:1789683849.294513:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789683849.294532:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22766:x1876618850358144:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789683849.294693:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22766:x1876618850358144:12345-0@lo:1000:mdt00_000.0 Request processed in 169us (5767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683849.294700:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789683849.294812:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6170380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22766:1876618850358144:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789683849.295023:0:22766:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901924 00000100:00100000:3.0:1789683849.295091:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22766:1876618850358272:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789683849.295128:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683849.296356:0:23773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850358272 00000100:00100000:2.0:1789683849.296367:0:23773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850358272 00000100:00100000:0.0:1789683849.296615:0:23773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789683849.296625:0:23773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22766:x1876618850358272:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789683849.296901:0:23773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22766:x1876618850358272:12345-0@lo:1000:mdt00_000.0 Request processed in 161us (1655us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1789683849.296918:0:23773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789683849.296953:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e844f5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683849.296983:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22766:1876618850358272:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789683849.297031:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297059:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297067:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297073:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683849.297078:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297087:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297104:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:0.0:1789683849.297106:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683849.297111:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297117:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2000/0xcf8485587b88b90c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297149:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297155:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297160:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297164:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683849.297175:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297181:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297189:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:0.0:1789683849.297205:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683849.297212:0:22766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b86b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc7c expref: 18 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297224:0:22766:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b86b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc7c expref: 18 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297233:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b86b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc7c expref: 18 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.297287:0:22766:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88b86b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcc7c expref: 18 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683849.297300:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dee680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22766:1876618850358400:192.168.201.50@tcp:105: 00000100:00100000:0.0:1789683849.302039:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f836129c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683849.312459:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683849.313542:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dee680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22766:1876618850358400:192.168.201.50@tcp:105: 00010000:00010000:1.0:1789683849.313571:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313581:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3200/0xcf8485587b88b864 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313629:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9800/0xcf8485587b88b913 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313642:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9800/0xcf8485587b88b913 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313654:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9800/0xcf8485587b88b913 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313681:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9800/0xcf8485587b88b913 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313688:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9800/0xcf8485587b88b913 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313695:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9800/0xcf8485587b88b913 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313701:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683849.313705:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9800/0xcf8485587b88b913 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313713:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9800/0xcf8485587b88b913 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313725:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:1.0:1789683849.313728:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683849.313732:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9800/0xcf8485587b88b913 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313737:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9800/0xcf8485587b88b913 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313745:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313749:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313756:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313766:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683849.313769:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313774:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313825:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:1.0:1789683849.313828:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789683849.313831:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.313836:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2200/0xcf8485587b88b905 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683849.314023:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9efedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+18:18850:x1876618835569408:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 54612us (54787us total) trans 12884901925 rc 0/0 00000100:00100000:1.0:1789683849.314032:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 70 00000020:00080000:1.0:1789683849.314039:0:22766:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789683849.314506:0:22800:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789683849.314511:0:22800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683849.314526:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789683849.314533:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1789683849.314897:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835569792 00000100:00100000:3.0:1789683849.314904:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835569792 00000100:00100000:3.0:1789683849.314957:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:3.0:1789683849.314965:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+18:18849:x1876618835569792:12345-192.168.201.50@tcp:49:bash.0 00000100:00100000:3.0:1789683849.315058:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+18:18849:x1876618835569792:12345-192.168.201.50@tcp:49:bash.0 Request processed in 94us (2610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683849.315065:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:1.0:1789683849.318435:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.320063:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835570048 00000100:00100000:3.0:1789683849.320077:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835570048 00000100:00100000:3.0:1789683849.320143:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:3.0:1789683849.320152:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9efed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+18:18850:x1876618835570048:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789683849.320432:0:22770:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789683849.321159:0:22770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901926 00010000:00010000:3.0:1789683849.321213:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b91a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.321230:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b91a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.321260:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b91a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.321269:0:22770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b91a lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.321275:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b91a lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.321280:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b91a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.321338:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789683849.321445:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9efed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+20:18850:x1876618835570048:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 1291us (3015us total) trans 12884901927 rc 0/0 00000100:00100000:3.0:1789683849.321455:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000020:00080000:3.0:1789683849.321461:0:22770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789683849.321526:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.321550:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835570176 00000100:00100000:3.0:1789683849.321555:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835570176 00000100:00100000:3.0:1789683849.321584:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:3.0:1789683849.321590:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+7:18849:x1876618835570176:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683849.321602:0:24278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683849.321616:0:24278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b921 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bccb4 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683849.321637:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aac6889, atime: 0x6aac6886, ctime: 0x6aac6889, blocks: 0x0 00010000:00010000:3.0:1789683849.321654:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=763s v=(0 0) 00010000:00010000:3.0:1789683849.321663:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683849.321672:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccb4 expref: 8 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.321687:0:24278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000318c528b/0xcf8485587b88b921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccb4 expref: 8 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.321700:0:24278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c3800, rc 0) 00000100:00100000:3.0:1789683849.321721:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+8:18849:x1876618835570176:12345-192.168.201.50@tcp:101:bash.0 Request processed in 131us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683849.321727:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:2.0:1789683849.326739:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.327301:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835570304 00000100:00100000:3.0:1789683849.327311:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835570304 00000100:00100000:3.0:1789683849.327370:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:3.0:1789683849.327392:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+20:18849:x1876618835570304:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683849.327414:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683849.327435:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b928 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bccbb expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.327470:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b92f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.327485:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b92f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.327497:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b92f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.327614:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b928 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccbb expref: 22 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.327643:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2400/0xcf8485587b88b92f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccbb expref: 21 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.327652:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:3.0:1789683849.327655:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789683849.327658:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e845c2400, rc 0) 00000100:00100000:3.0:1789683849.327713:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+21:18849:x1876618835570304:12345-192.168.201.50@tcp:101:bash.0 Request processed in 334us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683849.327721:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 71 00010000:00010000:1.0:1789683849.333871:0:22754:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683849.333885:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b91a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.333897:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683849.333901:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b91a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.333922:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b91a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.333959:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f0f854c2f00) 00010000:00010000:1.0:1789683849.333962:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789683849.333967:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b91a lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.333973:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3e00/0xcf8485587b88b91a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683849.333992:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683849.333994:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683849.333995:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683849.335273:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683849.335428:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835570560 00000100:00100000:1.0:1789683849.335437:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835570560 00000100:00100000:1.0:1789683849.335526:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:1.0:1789683849.335536:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+21:18849:x1876618835570560:12345-192.168.201.50@tcp:35:bash.0 00000001:00080000:1.0:1789683849.335948:0:22769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:1.0:1789683849.336105:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+23:18849:x1876618835570560:12345-192.168.201.50@tcp:35:bash.0 Request processed in 570us (921us total) trans 12884901929 rc 0/0 00000100:00100000:1.0:1789683849.336113:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000020:00080000:1.0:1789683849.336118:0:22769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789683849.376394:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683849.459861:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.459952:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835570816 00000100:00100000:3.0:1789683849.459962:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835570816 00000100:00100000:0.0:1789683849.460134:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:0.0:1789683849.460156:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+23:18860:x1876618835570816:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683849.460181:0:25531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683849.460200:0:25531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b936 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bccc2 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683849.460297:0:25531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789683849.460849:0:25531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b936 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccc2 expref: 25 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.460860:0:25531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f854c2500) 00010000:00010000:0.0:1789683849.460862:0:25531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683849.460866:0:25531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f829e0c00/0xcf8485587b88b936 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bccc2 expref: 25 pid: 25531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683849.460879:0:25531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0c00, rc 0) 00000100:00100000:0.0:1789683849.460952:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+24:18860:x1876618835570816:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 797us (1099us total) trans 12884901930 rc 301/301 00000100:00100000:0.0:1789683849.460959:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:0.0:1789683849.463842:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.463924:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835570944 00000100:00100000:3.0:1789683849.463934:0:22767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835570944 00000100:00100000:3.0:1789683849.463992:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:3.0:1789683849.464002:0:22767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+24:18860:x1876618835570944:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:3.0:1789683849.464084:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b944 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464103:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b944 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464115:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b944 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464130:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b94b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464156:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b94b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464164:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b94b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464250:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b952 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464259:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b952 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464265:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b952 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683849.464384:0:22767:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b952 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464409:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b944 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464416:0:22767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b944 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464423:0:22767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b944 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464430:0:22767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683849.464433:0:22767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b944 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464440:0:22767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b944 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464469:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f0e81f6d100) 00010000:00010000:3.0:1789683849.464472:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683849.464477:0:22767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b944 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464484:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2e00/0xcf8485587b88b944 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464497:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b94b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464504:0:22767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b94b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464510:0:22767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b94b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464515:0:22767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c3a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683849.464518:0:22767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b94b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464523:0:22767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b94b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464529:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f0e81f6d200) 00010000:00010000:3.0:1789683849.464531:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683849.464534:0:22767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b94b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464539:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c3a00/0xcf8485587b88b94b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464564:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b952 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464570:0:22767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b952 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464576:0:22767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b952 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464581:0:22767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e845c2600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683849.464585:0:22767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b952 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464591:0:22767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b952 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464598:0:22767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f0e81f6d700) 00010000:00010000:3.0:1789683849.464600:0:22767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683849.464603:0:22767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b952 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683849.464608:0:22767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e845c2600/0xcf8485587b88b952 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683849.464727:0:22767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+24:18860:x1876618835570944:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 725us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683849.464735:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:2.0:1789683849.469943:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683849.470021:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835571200 00000100:00100000:3.0:1789683849.470032:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835571200 00000100:00100000:3.0:1789683849.470099:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:3.0:1789683849.470123:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+24:18860:x1876618835571200:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683849.470365:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6dee52e-fd7e-4613-b7b8-6beab7d04952+25:18860:x1876618835571200:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 243us (430us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1789683849.470378:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:0.0:1789683849.750347:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.750388:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.750424:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.750462:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.750481:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.750500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683849.750525:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683849.750660:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835571456 00000100:00100000:1.0:1789683849.750684:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835571328 00000100:00100000:2.0:1789683849.750687:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835571456 00000100:00100000:1.0:1789683849.750688:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835571328 00000100:00100000:2.0:1789683849.750734:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835571712 00000100:00100000:1.0:1789683849.750735:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 168 00000100:00100000:2.0:1789683849.750737:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835571712 00000100:00100000:1.0:1789683849.750746:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+13:2405:x1876618835571328:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683849.750750:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835571840 00000100:00100000:2.0:1789683849.750752:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835571840 00000100:00100000:2.0:1789683849.750765:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:2.0:1789683849.750770:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2405:x1876618835571456:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683849.750873:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835571968 00000100:00100000:3.0:1789683849.750877:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835571968 00000100:00100000:3.0:1789683849.750922:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835571584 00000100:00100000:3.0:1789683849.750926:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835571584 00000100:00100000:3.0:1789683849.750939:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835572096 00000100:00100000:3.0:1789683849.750942:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835572096 00000100:00100000:3.0:1789683849.750957:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:3.0:1789683849.750964:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2405:x1876618835571968:12345-192.168.201.50@tcp:400:kworker.0 00000100:00080000:0.0:1789683849.751077:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683849.751087:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683849.751090:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683849.751092:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683849.751118:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:0.0:1789683849.751127:0:22766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:2405:x1876618835571712:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683849.751188:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04575703-9878-47d6-810f-62226c59585b+13:2405:x1876618835571328:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 443us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683849.751196:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 168 00000100:00100000:1.0:1789683849.751242:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:1.0:1789683849.751249:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2405:x1876618835571584:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683849.752804:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2405:x1876618835571456:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 2013us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683849.752817:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:2.0:1789683849.752854:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:2.0:1789683849.752866:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2405:x1876618835571840:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683849.753124:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2405:x1876618835571840:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 261us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683849.753131:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:2.0:1789683849.754356:0:24277:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789683849.754379:0:24277:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789683849.754411:0:24279:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789683849.754423:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:2.0:1789683849.754434:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2405:x1876618835572096:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683849.754625:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2405:x1876618835572096:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 192us (4097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683849.754632:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:3.0:1789683849.759654:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+5:2405:x1876618835571968:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 8673us (9211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683849.759673:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:0.0:1789683849.760743:0:22766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2d3d0b4-e58d-483d-a9cb-2bcdf1856e7c+6:2405:x1876618835571712:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 9613us (10348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683849.760755:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:1.0:1789683849.766118:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+5:2405:x1876618835571584:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 14856us (15622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683849.766135:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000040:00080000:2.0:1789683849.767008:0:23519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789683850.412821:0:22755:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683850.847006:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683850.847032:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850358528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683850.847109:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683850.847154:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850358528 00000100:00100000:3.0:1789683850.847162:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850358528 00000100:00100000:3.0:1789683850.847206:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683850.847219:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1876618850358528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683850.847251:0:24280:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789683850.847295:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1876618850358528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683850.847302:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683850.847367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850358528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683850.847639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850358656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683850.847672:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683850.847750:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850358656 00000100:00100000:0.0:1789683850.847755:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850358656 00000100:00100000:0.0:1789683850.847815:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789683850.847822:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9efec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850358656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683850.847833:0:24280:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789683850.847863:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9efec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850358656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683850.847869:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789683850.847937:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683850.847962:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850358656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683850.856846:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850358912:0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.867520:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683850.867586:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850359424:0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.867625:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683850.867648:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850359936:0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.867670:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683850.867695:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789683850.867702:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850359040:0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.867738:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683850.867760:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850359552:0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.867799:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683850.867817:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850360064:0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.867837:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683850.867874:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850359424 00000100:00100000:2.0:1789683850.867894:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850359424 00000100:00100000:2.0:1789683850.867947:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850359040 00000100:00100000:2.0:1789683850.867951:0:24279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850359040 00000100:00100000:2.0:1789683850.867970:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789683850.867978:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850359424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.868029:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850359424:12345-0@lo:400:kworker.0 Request processed in 52us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683850.868037:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789683850.868055:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789683850.868060:0:24279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850359040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.868085:0:24279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850359040:12345-0@lo:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683850.868091:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789683850.868108:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850359936 00000100:00100000:2.0:1789683850.868117:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850359936 00000100:00100000:2.0:1789683850.868151:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850359552 00000100:00100000:2.0:1789683850.868154:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850359552 00000100:00100000:2.0:1789683850.868165:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850360064 00000100:00100000:2.0:1789683850.868167:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850360064 00000100:00100000:2.0:1789683850.868182:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789683850.868188:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850359936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.868217:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850359936:12345-0@lo:400:kworker.0 Request processed in 29us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683850.868223:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789683850.868235:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789683850.868241:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850359552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.868263:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850359552:12345-0@lo:400:kworker.0 Request processed in 23us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683850.868269:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789683850.868279:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789683850.868284:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850360064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.868309:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850360064:12345-0@lo:400:kworker.0 Request processed in 24us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683850.868314:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789683850.868363:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850359040:0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.868373:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850359552:0@lo:400:kworker.0 00010000:00080000:2.0:1789683850.868384:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83e03b80 x1876618850360064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683850.868394:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850360064:0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.868415:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850359424:0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.868423:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850359936:0@lo:400:kworker.0 00000100:00100000:3.0:1789683850.868532:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850358912 00000100:00100000:3.0:1789683850.868537:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850358912 00000100:00100000:3.0:1789683850.868574:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789683850.868580:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850358912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683850.868617:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850358912:12345-0@lo:400:kworker.0 Request processed in 37us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683850.868624:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789683850.872087:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850358912:0@lo:400:kworker.0 00000100:00100000:1.0:1789683850.872867:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850358784:0@lo:400:kworker.0 00000100:00100000:1.0:1789683850.872961:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683850.873013:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850359296:0@lo:400:kworker.0 00000100:00100000:1.0:1789683850.873041:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683850.873071:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850359808:0@lo:400:kworker.0 00000100:00100000:1.0:1789683850.873125:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683850.873152:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789683850.873159:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850359168:0@lo:400:kworker.0 00000100:00100000:1.0:1789683850.873180:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683850.873195:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850359680:0@lo:400:kworker.0 00000100:00100000:1.0:1789683850.873214:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683850.873245:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850359808 00000100:00100000:1.0:1789683850.873254:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850359808 00000100:00100000:1.0:1789683850.873301:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850359168 00000100:00100000:1.0:1789683850.873304:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850359168 00000100:00100000:1.0:1789683850.873315:0:25531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850359680 00000100:00100000:1.0:1789683850.873324:0:25531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850359680 00000100:00100000:1.0:1789683850.873345:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789683850.873354:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9efef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850359808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683850.873411:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9efef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850359808:12345-0@lo:400:kworker.0 Request processed in 58us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683850.873419:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789683850.873437:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789683850.873442:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9efeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850359168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683850.873467:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9efeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850359168:12345-0@lo:400:kworker.0 Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683850.873474:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789683850.873484:0:25531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789683850.873490:0:25531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9efefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850359680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683850.873514:0:25531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9efefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850359680:12345-0@lo:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683850.873519:0:25531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789683850.873553:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850359168:0@lo:400:kworker.0 00000100:00100000:1.0:1789683850.873562:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850359680:0@lo:400:kworker.0 00010000:00080000:1.0:1789683850.873572:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83e02300 x1876618850359808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683850.873581:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850359808:0@lo:400:kworker.0 00000100:00080000:1.0:1789683850.873603:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683850.873608:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683850.873611:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683850.873712:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850359296 00000100:00100000:3.0:1789683850.873718:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850359296 00000100:00100000:3.0:1789683850.873757:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789683850.873765:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9efef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850359296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683850.873830:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9efef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850359296:12345-0@lo:400:kworker.0 Request processed in 65us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683850.873837:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789683850.873923:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850359296:0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.875834:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850358784 00000100:00100000:2.0:1789683850.875847:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850358784 00000100:00100000:2.0:1789683850.875910:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789683850.875919:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:3648:x1876618850358784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683850.875999:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acf86134-5469-4898-92a9-e106d5944cd1+24:3648:x1876618850358784:12345-0@lo:400:kworker.0 Request processed in 81us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683850.876007:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789683850.878627:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:acf86134-5469-4898-92a9-e106d5944cd1:3648:1876618850358784:0@lo:400:kworker.0 00000001:02000400:1.0:1789683851.231274:0:25853:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1789683851.359775:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683851.359820:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f9efeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850360192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683851.359900:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683851.359995:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850360192 00000100:00100000:1.0:1789683851.360004:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850360192 00000100:00100000:1.0:1789683851.360064:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789683851.360073:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850360192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683851.360106:0:24280:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789683851.360153:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850360192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683851.360160:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683851.360264:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f9efeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850360192:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789683851.422966:0:22754:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789683852.385417:0:22800:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789683852.385427:0:22800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683852.385445:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789683852.385455:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1789683852.454833:0:23923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683852.839320:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683852.839360:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683852.839421:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835572352 00000100:00100000:3.0:1789683852.839432:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835572352 00000100:00100000:3.0:1789683852.839499:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:3.0:1789683852.839511:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9efef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+8:2404:x1876618835572352:12345-192.168.201.50@tcp:16:kworker.0 00000100:00100000:3.0:1789683852.839630:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9efef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6dee52e-fd7e-4613-b7b8-6beab7d04952+8:2404:x1876618835572352:12345-192.168.201.50@tcp:16:kworker.0 Request processed in 122us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683852.839646:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00080000:1.0:1789683852.839859:0:22762:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683852.840059:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835572224 00000100:00100000:2.0:1789683852.840065:0:24282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835572224 00002000:00100000:2.0:1789683852.840097:0:24282:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9f0f9efedc00 x1876618835572224/t0(0) o4->c6dee52e-fd7e-4613-b7b8-6beab7d04952@192.168.201.50@tcp:153/0 lens 504/0 e 0 to 0 dl 1789683863 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789683852.840107:0:24282:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0f9efedc00 with x1876618835572224 ext(0->8) 00002000:00010000:2.0:1789683852.840113:0:24282:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f0f9efedc00 00000100:00100000:2.0:1789683852.840138:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:2.0:1789683852.840145:0:24282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f9efedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+8:2404:x1876618835572224:12345-192.168.201.50@tcp:4:bash.0 00000100:00100000:0.0:1789683852.853731:0:24282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f9efedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6dee52e-fd7e-4613-b7b8-6beab7d04952+10:2404:x1876618835572224:12345-192.168.201.50@tcp:4:bash.0 Request processed in 13574us (14406us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1789683852.853753:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00002000:00100000:0.0:1789683852.853769:0:24282:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9f0f9efedc00 x1876618835572224/t12884901895(0) o4->c6dee52e-fd7e-4613-b7b8-6beab7d04952@192.168.201.50@tcp:153/0 lens 504/448 e 0 to 0 dl 1789683863 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789683852.853780:0:24282:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0f9efedc00 with x1876618835572224 ext(0->8) 00002000:00010000:0.0:1789683852.853828:0:24282:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f0f9efedc00 Debug log: 14902 lines, 14902 kept, 0 dropped, 0 bad.